Skip to content

Commit 0c3ebaa

Browse files
authored
Arm backend: Add tutorial for dynamic range 8x8. (pytorch#22930)
Adds a VGF tutorial for dynamic W8A8 quantization. The tutorial covers: * configuring `VgfQuantizer` for dynamic INT8 activations and static INT8 weights; * preparing and converting a model with PT2E; * lowering the quantized model to VGF; * generating and running the resulting `.pte`; * applying the flow to DeiT-Tiny. It also explains the dynamic activation qparam flow and the INT8 MATMUL → INT32 accumulation → FP32 rescaling path. Assisted with Codex. cc @digantdesai @freddan80 @per @zingo @oscarandersson8218 @mansnils @Sebastian-Larsson @robell @rascani Signed-off-by: Elena Zhelezina <elena.zhelezina@arm.com>
1 parent 3757a0b commit 0c3ebaa

3 files changed

Lines changed: 542 additions & 0 deletions

File tree

‎docs/source/backends/arm-vgf/arm-vgf-overview.md‎

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -140,6 +140,8 @@ described in the rest of this guide but with a concrete end-to-end sample.
140140

141141
**→{doc}`/backends/arm-vgf/tutorials/vgf-getting-started` — Getting started tutorial.**
142142

143+
**→{doc}`/backends/arm-vgf/tutorials/vgf-dynamic-w8a8-quantization` — Dynamic W8A8 quantization tutorial.**
144+
143145
**→{doc}`/backends/arm-vgf/VGF_op_support` — VGF supported operators.**
144146

145147

@@ -152,5 +154,6 @@ arm-vgf-partitioner
152154
arm-vgf-quantization
153155
arm-vgf-troubleshooting
154156
tutorials/vgf-getting-started
157+
tutorials/vgf-dynamic-w8a8-quantization
155158
VGF_op_support
156159
```

‎docs/source/backends/arm-vgf/arm-vgf-quantization.md‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,8 @@ The quantization schemes supported by the VGF Backend are:
1313

1414
Weight-only quantization is not currently supported on the VGF backend.
1515

16+
For an end-to-end example of configuring and exporting dynamic W8A8 Linear layers, see the [Dynamic W8A8 Quantization Tutorial](tutorials/vgf-dynamic-w8a8-quantization.md).
17+
1618
### Partial Quantization
1719

1820
The VGF backend supports partial quantization, where only parts of the model

0 commit comments

Comments
 (0)