#
hf-datasets
Here are 5 public repositories matching this topic...
This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Dataflow.
-
Updated
Oct 20, 2022 - Python
Aspect ratio bucketing for diffusion training. PyTorch native, DDP correct, no training-framework lock-in.
training machine-learning aspect-ratio pytorch vae dataloader data-pipeline diffusion bucketing huggingface hf-datasets stable-diffusion sdxl
-
Updated
May 15, 2026 - Python
A GUI for managing, visualizing, and analyzing competitive programming datasets with a PyQt6 GUI.
python gui leetcode hackerrank dataset geeksforgeeks dataset-creation leetcode-solutions datasets dataset-manager uv dataset-generator huggingface dataset-collection datasets-preparation hf-datasets cp-dataset-gui
-
Updated
Dec 1, 2025 - Python
A simple toolkit to transform datasource generate by img2dataset from parquet file to Huggingface dataset.
arrow image-processing dataset image-captioning parquet datasets image-downloader image-caption pyarrow hf-datasets img2dataset
-
Updated
Mar 21, 2023 - Python
Add this topic to your repo
To associate your repository with the hf-datasets topic, visit your repo's landing page and select "manage topics."