Skip to content

Latest commit

 

History

History
30 lines (23 loc) · 423 Bytes

quantization.mdx

File metadata and controls

30 lines (23 loc) · 423 Bytes
title Quantization

Example Usage

from openrouter.components import Quantization

# Open enum: unrecognized values are captured as UnrecognizedStr
value: Quantization = "int4"

Values

This is an open enum. Unrecognized values will not fail type checks.

  • "int4"
  • "int8"
  • "fp4"
  • "mxfp4"
  • "nvfp4"
  • "fp6"
  • "fp8"
  • "mxfp8"
  • "fp16"
  • "bf16"
  • "fp32"
  • "unknown"