You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 4a3bc34
Browse filesBrowse the repository at this point in the historyBrowse files
Metal backend: Enable Voxtral Realtime (pytorch#17536)
This pull request adds Metal backend support for the Voxtral Realtime
model (offline mode, streaming support is coming next)
**Voxtral Realtime Metal backend support:**
* Added Metal backend support to `export_voxtral_rt.py`, including
custom decompositions and dynamic shape handling for Metal/AOTI
compatibility. Also added validation for Metal-specific quantization
(`fpa4w`).
* Updated `export_model_artifact.sh` and `test_model_e2e.sh` scripts to
support a new `mode` parameter. This is used in the Voxtral Realtime
model for selecting between streaming/offline export modes.
**CI/CD and workflow updates:**
* Added quantized `Voxtral-Mini-4B-Realtime-2602` to Metal workflow
matrix.
* Added new CMake presets for building and testing the Voxtral Realtime
runner with Metal backend.
0 commit comments