You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit b863992
Browse filesBrowse the repository at this point in the historyBrowse files
Qualcomm AI Engine Direct - Support SLC allocator feature (pytorch#17302)
Summary:
- Support SLC allocator feature setting
- Support spill-fill buffer for hybrid mode
- Fixed redundant convert_op in 8w8a quantization config
Test Plan:
- Check the debug log to confirm if the SLC allocator is enabled.
```
I [Qnn ExecuTorch]: QnnDsp <V> SLC_ALLOCATOR is set to 1 for graph 0
```
- Check the debug log whether the spill-fill buffer is configured for
the LLM in hybrid mode.
```
python examples/qualcomm/oss_scripts/llama/llama.py -b build-android -H ${HOST} -s ${DEVICE} -m SM8750 --temperature 0 --model_mode hybrid --max_seq_len 128 --prefill_ar_len 32 --decoder_model smollm2_135m --prompt "I would like to learn python, could you teach me with a simple example?" --artifact {ARTIFACTS}
```
0 commit comments