You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 32fb206
Browse filesBrowse the repository at this point in the historyBrowse files
Add KleiDI BF16 GEMM and SDPA dispatch (pytorch#22886)
Summary:
Add KleiDI NEON and SME2 BF16 GEMM dispatch for Arm64 and route BF16 SDPA prefill through it. Keep single-column decode on BFDOT and retain fallbacks for unsupported CPUs or older KleiDI builds. Scalar NEON packing and an adapter for the existing SME RHS packer allow this integration to land before the new upstream packers.
AI-assisted: Codex.
Reviewed By: digantdesai, Gasoonjia
Differential Revision: D119433385
Pull Request resolved: pytorch#22886
0 commit comments