All issues

Search results

[CI] Invalid top-k grouping in GLM-5 and Kimi-K2.5 NVFP4 MoE benchmarks

needs-triage

Status: Open.

#4867 In flashinfer-ai/flashinfer;

· yufeiwu-nv opened on Sep 1, 2026

SM120 paged prefill, head_dim 256 / page_size 1, INT8-QK / FP8-PV over an unquantized KV pool — experimental track? (+ D256/CUDA-graph test evidence relevant to #4714)

needs-triage

Status: Open.

#4858 In flashinfer-ai/flashinfer;

· sherkaner-underhill opened on Sep 1, 2026

cuTile MoE progress tracker

op: moe

Status: Open.

#4857 In flashinfer-ai/flashinfer;

· bkryu opened on Sep 1, 2026

[SM120] trtllm cutlass fused-MoE: autotuned (non-default) tactics intermittently corrupt generation under CUDA-graph serving; 14/60 tactics presented on NVFP4 cannot run at all

needs-triage

Status: Open.

#4841 In flashinfer-ai/flashinfer;

· SSHdotCodes opened on Aug 31, 2026

[Bug] BatchMLAPagedAttentionWrapper fails when kv_len_arr metadata is not rank-1

needs-triage

Status: Open.

#4833 In flashinfer-ai/flashinfer;

· yufeiwu-nv opened on Aug 31, 2026

[Feature]: TRTLLM-GEN FMHA graph-safe request permutation and length-aware scheduling for ragged decode

needs-triage

Status: Open.

#4832 In flashinfer-ai/flashinfer;

· YAMY1234 opened on Aug 31, 2026

trtllm-gen GEMM/MoE 2x1x1 (2-CTA cluster) tactics can deadlock on B300 (MXFP4 fused MoE)

bugSomething isn't workingSomething isn't working

needs-triage

Status: Open.

#4814 In flashinfer-ai/flashinfer;

· henrylhtsang opened on Aug 29, 2026

OnlineSoftmaxWithSink::finalize misses the exponent clamps its FA2 twin has — non-finite sink values yield NaN

needs-triage

Status: Open.

#4807 In flashinfer-ai/flashinfer;

· headinthebox opened on Aug 28, 2026

[Bug][v0.6.18rc10] test_trtllm_gen_attention_prefill AssertionError: Tensor-likes are not close! Mismatched elements: 4007 / 541663232 (0.0%) Greatest absolute difference: 96.5625 at index (3626, 2, 79) (up to 0.1 allowed)

needs-triage

Status: Open.

#4800 In flashinfer-ai/flashinfer;

· nvamyt opened on Aug 28, 2026

[Bug][v0.6.18rc10] cudnn._compiled_module.cudnnGraphNotSupportedError: Mixed-form sequence lengths (cu_seq_len on one side with seq_len on the other) require cuDNN 9.25.0 or above

needs-triage

Status: Open.

#4799 In flashinfer-ai/flashinfer;

· nvamyt opened on Aug 28, 2026

[Bug] JIT: bgmv_moe rebuilds from scratch in every process because shutil.copy resets the copied sources' mtime

needs-triage

Status: Open.

#4782 In flashinfer-ai/flashinfer;

· yufeiwu-nv opened on Aug 27, 2026

[Bug] flashinfer-cubin wheels missing on PyPI for >=0.6.14 — version check breaks every vLLM >= 0.27 on DGX Spark (GB10/aarch64)

needs-triage

Status: Open.

#4781 In flashinfer-ai/flashinfer;

· skbotoc1-web opened on Aug 27, 2026