Training CLIP models on Data from Scientific Papers
-
Updated
Nov 9, 2023 - TeX
#
img2dataset
Here are 3 public repositories matching this topic...
Bulk-download image-text datasets into Backblaze B2 as reproducible WebDataset tar shards with img2dataset — no local staging disk. Sample app (FastAPI + Next.js) that streams shards to S3-compatible object storage, validates download yield, and streams them back for PyTorch/JAX training.
machine-learning nextjs s3 pytorch sample-app dataset object-storage backblaze-b2 cloudstorage training-data fastapi webdataset img2dataset b2-labs
-
Updated
Sep 2, 2026 - TypeScript
A simple toolkit to transform datasource generate by img2dataset from parquet file to Huggingface dataset.
arrow image-processing dataset image-captioning parquet datasets image-downloader image-caption pyarrow hf-datasets img2dataset
-
Updated
Mar 21, 2023 - Python
Add this topic to your repo
To associate your repository with the img2dataset topic, visit your repo's landing page and select "manage topics."