infinite-batch-size

Here is 1 public repository matching this topic...

DAMO-NLP-SG / Inf-CLIP

[CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A super memory-efficiency CLIP training scheme.

memory-efficient clip contrastive-learning flash-attention ring-attention infinite-batch-size

Updated Jan 16, 2025
Python

Add this topic to your repo

To associate your repository with the infinite-batch-size topic, visit your repo's landing page and select "manage topics."

Learn more