Data Science & Analytics

Launching Evals

Run, monitor, analyze, and debug LLM evaluations via nemo-evaluator-launcher. Covers running evaluations, checking status and live progress, debugging failed runs, exporting artifacts and logs, and analyzing results. ALWAYS triggers on mentions of running evaluations, checking progress, debugging failed evals, analyzing or analysing runs or results, run directories or artifact paths on clusters, Slurm job issues, invocation IDs, or inspecting logs (client logs, server logs, SSH to cluster, tail logs, grep logs). Do NOT use for creating or modifying evaluation configs.

Publisher / source
NVIDIA/Model-Optimizer (found on GitHub top repositories)
Upstream record
NVIDIA/Model-Optimizer
Version
Version 1
Published
Publication review
Approved for publication
Content fingerprint
c2a3e3a17935ed6d2775d13a0efcad83a8937b2d42f292deffe919742dd94d40