Skip to content

quantize

Model quantization CLI handler

Attributes

Classes

QuantizeCLI 

QuantizeCLI(config: str | None = None)

Bases: BaseCLI

Model quantization tools

CLI base class

Warning

An odd behavior with Fire has been observed where subclasses of BaseCLI take override __init__ and take parameters caus Fire to incorrectly identify self as a required CLI argument.

Parameters:

  • config (str, default: None ) –

    Path to configuration file

Functions

calibration_dataset 
calibration_dataset()

Build a model calibration dataset

name classmethod 
name() -> str
run 
run(model: str) -> None