AI & Machine Learning
ModelOpt Speculative Decoding
Train, debug, and validate a speculative decoding draft model (EAGLE3, DFlash, DSpark, Domino) through the ModelOpt launcher pipeline. Use when the user wants to add a new model to a draft-training pipeline, asks why a pipeline run failed, wants experiment logs reviewed, or wants to check whether a run's acceptance rate meets threshold. Triggers on "EAGLE3", "DFlash", "DSpark", "Domino", "draft model", "acceptance rate", "speculative decoding pipeline". Do NOT use for quantizing a model (use modelopt-ptq) or serving a checkpoint (use modelopt-deployment).
- Publisher / source
- NVIDIA/Model-Optimizer (found on GitHub top repositories)
- Upstream record
- NVIDIA/Model-Optimizer
- Version
- Version 1
- Published
- Publication review
- Approved for publication
- Content fingerprint
e6229271c7f87aeb96f61c3fff23e3b9056677e1c2a3c2c7d754832d3cd461a0