Software Development

Quant Recipe Search

Use when the user asks to find, search for, or optimize the best quantization recipe for a model, including direct requests like "find the best quantization recipe and generate a PTQ checkpoint." Guides the multi-candidate loop: choose compute-vs-memory success metrics, select ModelOpt recipe baselines, design AutoQuant/manual recipe deltas, interpret sensitivity, and decide next candidates. Do NOT use for a single known PTQ recipe run (use ptq), serving (use deployment), creating/running evals (use evaluation or launching-evals), monitoring jobs (use monitor), MLflow browsing (use accessing-mlflow), or comparing completed baseline-vs-candidate scores only (use compare-results).

Publisher / source
NVIDIA/Model-Optimizer (found on GitHub top repositories)
Upstream record
NVIDIA/Model-Optimizer
Version
Version 1
Published
Publication review
Approved for publication
Content fingerprint
2fbf14aedc6d0125bf3bb11b3f8d70d96b1f44495443fe6af969a7d1fcc71edc