GitHub - qcri/c4-qcri: replicate c4 dateset process without Apache Beam, use Slurm instead · GitHub

Name		Name	Last commit message	Last commit date
ar-badwords.txt		ar-badwords.txt
c4-filter.py		c4-filter.py
c4-qcri.sh		c4-qcri.sh
corrupted.lst		corrupted.lst
download_books.py		download_books.py
pack.sh		pack.sh
parallel.sh		parallel.sh
requirements.txt		requirements.txt
sampling_domains.py		sampling_domains.py
split_wet_file.py		split_wet_file.py

About

replicate c4 dateset process without Apache Beam, use Slurm instead

Custom properties

0 stars

0 watching

Report repository

Releases

Packages

Contributors

Languages