Skip to content

Pull requests: alibaba/rtp-llm

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort

Pull requests list

fix: overlap CUDA graph replay preparation on PRO5000
#1365 opened Sep 1, 2026 by siluzhou Collaborator Loading…
perf(sm120): use Triton FP8 MoE for small decode batches
#1364 opened Sep 1, 2026 by siluzhou Collaborator Loading…
Feat/sm120 deepgemm fp8
#1362 opened Aug 31, 2026 by parkerpang Collaborator Loading…
feat: support full prefill CUDA graphDevelop/full prefill cuda graph
#1360 opened Aug 31, 2026 by siluzhou Collaborator Loading…
feat(flexlb): support Nacos local standby hot updates
#1358 opened Aug 31, 2026 by Martin7-1 Collaborator Loading…
feat(flexlb): configure vllm block hashing
#1357 opened Aug 31, 2026 by Martin7-1 Collaborator Loading…
feat(rocm): add AITER FlyDSL GDN decode adapter
#1355 opened Aug 31, 2026 by junna2016 Collaborator Loading…
feat(loader): integrate bounded rank-local FastSafeTensors copyout
#1354 opened Aug 30, 2026 by ABNER-1 Collaborator Loading…
feat: add RDMA transport for ViT output
#1353 opened Aug 30, 2026 by ydshi0 Collaborator Loading…
mimo v2.5 support
#1351 opened Aug 29, 2026 by RK-PHG Loading…
feat(sm120): enable DSv4 Flash 0731 inference support
#1350 opened Aug 28, 2026 by MMadhatter Collaborator Loading…
feat(ascend): add Huawei Ascend NPU support
#1349 opened Aug 28, 2026 by ningweikang Loading…
Dev/main block tree cache 0828
#1348 opened Aug 28, 2026 by MMeecatfish Collaborator Loading…
feat: add cross-node CPU TP broadcast
#1347 opened Aug 28, 2026 by xinfei-shi Collaborator Loading…
feat: monitor repeated model output
#1346 opened Aug 28, 2026 by xinfei-shi Collaborator Loading…
feat(rocm): add shape-based AITER FMoE tuning
#1345 opened Aug 28, 2026 by yzyDavid Collaborator Loading…
fix: improve RPC/cache-store diagnostics and xgrammar loading
#1344 opened Aug 28, 2026 by xinfei-shi Collaborator Loading…
feat: qwen35 share expert and deepep combine overlap
#1343 opened Aug 28, 2026 by HongminTan Collaborator Loading…
feat(cache): add native KVCM cache event publisher
#1340 opened Aug 27, 2026 by putaopi7 Collaborator Loading…
fix: keep decode rope positions on CUDA
#1337 opened Aug 26, 2026 by siluzhou Collaborator Loading…
feat: add KVCM fallback to master client
#1335 opened Aug 26, 2026 by Zhanghyi Loading…
Drop deprecated DeepSeek smoke cases, fix DSv4 CP prefill + thinking_mode
#1333 opened Aug 26, 2026 by netaddi Collaborator Loading…
4 of 5 tasks
feat(flexlb): support logical multi-engine workers
#1332 opened Aug 25, 2026 by Martin7-1 Collaborator Loading…
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.