Software Development

Speculative Decoding

Train, debug, and validate a speculative decoding draft model (EAGLE3, DFlash, DSpark, Domino) through the ModelOpt launcher pipeline. Use when the user wants to add a new model to a draft-training pipeline, asks why a pipeline run failed, wants experiment logs reviewed, or wants to check whether a run's acceptance rate meets threshold. Triggers on "EAGLE3", "DFlash", "DSpark", "Domino", "draft model", "acceptance rate", "speculative decoding pipeline". Do NOT use for quantizing a model (use ptq) or serving a checkpoint (use deployment).

Publisher / source
NVIDIA/Model-Optimizer (found on GitHub top repositories)
Upstream record
NVIDIA/Model-Optimizer
Version
Version 1
Published
Publication review
Approved for publication
Content fingerprint
2bb267acc9c992f1f75c76dc23dcc7e861578714ea4c8782c242a0cdaccacf16