A high-performance Python utility for splitting large text files into smaller, manageable parts. Built for processing large datasets and files at high throughput using efficient, streaming I/O.
- 🚀 High Performance: Memory-efficient processing of large files
- 📊 Flexible Splitting: Split by number of parts OR lines per file
- 🎨 Colored Terminal: Optional color banner and progress feedback
- 📁 Smart Management: Auto output directory creation and overwrite protection
- 🔄 Progress Tracking: Real-time updates for large files
- Python 3.6+
- Optional:
pyfigletfor an ASCII-art banner
git clone https://github.com/dk3yyyy/combo-splitter.git
cd combo-splitter
pip install pyfiglet # optional
python splitter.py- File Selection: Enter path to your text file
- Split Method: Choose by number of parts or lines per file
- Output: Files saved as
filename_part1.txt,filename_part2.txt, etc.
$ python splitter.py
Enter the path to the text file to split: large_data.txt
How would you like to split the file?
1. By number of parts
2. By lines per file
Enter 1 or 2: 2
Enter the number of lines per file: 1000000
Created: large_data_part1.txt (1000000 lines)
Created: large_data_part2.txt (500000 lines)
Summary: 1500000 lines processed, 2 file(s) created.
- Memory: Constant usage regardless of file size
- Speed: ~1M lines per minute
- File Size: No practical limit
Built by: dk3yyyy
Tech Stack: Python
MIT License - Free to use and modify
If you find this useful:
- ⭐ Star the repository
- 🍴 Fork and contribute