Repository navigation
Commit 0c3ebaa
authored
Arm backend: Add tutorial for dynamic range 8x8. (pytorch#22930)
Adds a VGF tutorial for dynamic W8A8 quantization.
The tutorial covers:
* configuring `VgfQuantizer` for dynamic INT8 activations and static
INT8 weights;
* preparing and converting a model with PT2E;
* lowering the quantized model to VGF;
* generating and running the resulting `.pte`;
* applying the flow to DeiT-Tiny.
It also explains the dynamic activation qparam flow and the INT8 MATMUL
→ INT32 accumulation → FP32 rescaling path.
Assisted with Codex.
cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils
@Sebastian-Larsson @robell @rascani
Signed-off-by: Elena Zhelezina <elena.zhelezina@arm.com>1 parent 3757a0b commit 0c3ebaa
3 files changed
Lines changed: 542 additions & 0 deletions
File tree
- docs/source/backends/arm-vgf
- tutorials
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
140 | 140 | | |
141 | 141 | | |
142 | 142 | | |
| 143 | + | |
| 144 | + | |
143 | 145 | | |
144 | 146 | | |
145 | 147 | | |
| |||
152 | 154 | | |
153 | 155 | | |
154 | 156 | | |
| 157 | + | |
155 | 158 | | |
156 | 159 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
| 16 | + | |
| 17 | + | |
16 | 18 | | |
17 | 19 | | |
18 | 20 | | |
| |||
0 commit comments