Skip to content

Does executorch support qat quant for qualcomm qnn backend? #2169

Closed

Description

@Novelfor

I want to use qat method for my model, but i can only find ptq quantizer in executorch, are there some examples of how to implement Quantization Aware Training (QAT) for qnn backend?

Activity

  1. added
    partner: qualcommFor backend delegation, kernels, demo, etc. from the 3rd-party partner, Qualcomm
    on Mar 7, 2024
  2. added
    partner: qualcommFor backend delegation, kernels, demo, etc. from the 3rd-party partner, Qualcomm
    and removed
    partner: qualcommFor backend delegation, kernels, demo, etc. from the 3rd-party partner, Qualcomm
    on May 13, 2024
  3. jerryzh168 commented on May 16, 2024

    @jerryzh168
    Contributor

    QAT is going through the same code path as PTQ. if you don't have some special handling for conv-bn, you could start with adding the configuration for QAT, like: https://github.com/pytorch/pytorch/blob/a0429c01ad665ffb2faa04a411913ecee9962566/torch/ao/quantization/quantizer/xnnpack_quantizer.py#L116

  4. jerryzh168 commented on Feb 4, 2025

    @jerryzh168
    Contributor

    @cccclai can you tag qualcomm POC to see if they want to support QAT?

  5. cccclai commented on Feb 4, 2025

    @cccclai
    Contributor

    Yeah QAT is supported. cc: @shewu-quic @chunit-quic @haowhsu-quic @winskuo-quic let's add some docs

  6. locked and limited conversation to collaborators on Feb 5, 2025
  7. converted this issue into a discussion #8215 on Feb 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    module: quantizationIssues related to quantizationpartner: qualcommFor backend delegation, kernels, demo, etc. from the 3rd-party partner, Qualcomm

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions