Repository navigation

All pull requests

Fix the Issue of Interactive Mode Not Working Properly
#238GradientRipple opened Apr 4, 2026
fix(generate.py): add mock FlexDecoding test integration for speculative pipeline verification
#235Shraman123 opened Nov 12, 2025
3
Support generation tasks for eval.py
#206mostafaelhoushi opened Oct 4, 2024
add huggingface-hub
#205kunschg opened Oct 3, 2024
update README.md
#204kunschg opened Oct 3, 2024
feat: add Llama-3.2-[1B/3B] support
#203stillmatic opened Oct 1, 2024
2
Add Phi-3-mini-4k-instruct bfloat16/int8
#195makaveli10 opened Aug 20, 2024
8
int4 quantization cpu fix
#193likholat opened Aug 1, 2024
3
flex_attention ver.
#192joydddd opened Jul 30, 2024
2
Update sdpa function with enable_gqa=True
#191jainapurva opened Jul 13, 2024
1
Decouple int4 weight with serialized format
#187yanbing-j opened Jul 2, 2024
9
[WIP] Use DTensor-based tensor parallel
#180kwen2501 opened Jun 12, 2024
1
[example] Add support for DBRX
#174yanboliang opened May 7, 2024Contributor
1
[example] Added (hacky) Grok1 support
#171Chillee opened May 5, 2024Contributor
3
Making TokenizerInterface more usable for the user's code.
#170Artyom17 opened Apr 30, 2024Contributor
Remove used empty variable
#164yncxcw opened Apr 26, 2024
2
Add download script for tinyllamas
#163yiliu30 opened Apr 24, 2024
4
Optimize Int8 Woq for CPU
#161yanbing-j opened Apr 23, 2024
2
Fixing quantize in int4 mode
#159Artyom17 opened Apr 19, 2024Contributor
5
fix input_pos shape in comment
#157YassineYousfi opened Apr 18, 2024
2
Fixing block size for Mistral-7B.
#141Artyom17 opened Mar 19, 2024Contributor
1
Optimized the process of loading PyTorch state dictionaries, merging …
#133hvaria opened Mar 12, 2024
2
Updating requirements.txt and .gitignore
#119Artyom17 opened Feb 29, 2024Contributor
[example] Added gemma support
#115Chillee opened Feb 29, 2024Contributor
6
generate.py: do not use args in function main
#80guoyejun opened Jan 10, 2024

Pull requests