AI & Machine Learning

ModelOpt QAD

Run explicitly requested ModelOpt Quantization-Aware Distillation (QAD) through Megatron Bridge (recommended) or Hugging Face Transformers to recover a measured BF16-to-PTQ accuracy gap. Use only when the user explicitly asks for QAD, including its topology, data preparation, launch, resume, checkpoint export, or recovery decisions.

Publisher / source
NVIDIA/Model-Optimizer (found on GitHub top repositories)
Upstream record
NVIDIA/Model-Optimizer
Version
Version 1
Published
Publication review
Approved for publication
Content fingerprint
8090221acfbd2ec6cbe6bd64217034c0d7eb73673494fdb0a39153eb52239177