Repository navigation
Commit 2187fc0
authored
Qualcomm AI Engine Direct - heap profiling at runtime on target (pytorch#20272)
### Summary
Heap profiling at runtime with HTP backend on Android platforms. DSP
heap profiling is available for QnnContext_createFromBinary use-cases.
It captures total DSP heap usage at two checkpoints:
- Before the first context is created (before_context_created)
- After the last context is freed (after_context_freed)
The difference between the two values represents heap consumed during
context execution. The value after freeing is typically equal to or
greater than before creation.
### Test plan
python backends/qualcomm/tests/test_qnn_delegate.py
TestQNNQuantizedUtils.test_qnn_backend_runtime_option_heap_profile -b
build-android -H ${HOST} -s ${SN} -m ${SOC_MODEL}
### Note
This test is expected to run on target device.1 parent 0378fc4 commit 2187fc0
1 file changed
Lines changed: 4 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
6181 | 6181 | | |
6182 | 6182 | | |
6183 | 6183 | | |
| 6184 | + | |
| 6185 | + | |
6184 | 6186 | | |
6185 | 6187 | | |
6186 | 6188 | | |
| |||
7122 | 7124 | | |
7123 | 7125 | | |
7124 | 7126 | | |
| 7127 | + | |
| 7128 | + | |
7125 | 7129 | | |
7126 | 7130 | | |
7127 | 7131 | | |
| |||
0 commit comments