Skip to content

Add vLLM NVFP4 MLA KV-cache fake quant - #2620

Merged
sychen52 merged 2 commits into
NVIDIA:mainfrom
sychen52:glm5.3-flash-kv
Oct 3, 2026
Merged

Add vLLM NVFP4 MLA KV-cache fake quant#2620
sychen52 merged 2 commits into
NVIDIA:mainfrom
sychen52:glm5.3-flash-kv

Quantize the MLA RoPE key to FP8 in the kv_nvfp4_mla unit

1e3a6c9
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 2, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO