AI & Machine Learning

Nemo Mbridge Perf Activation Recompute

The Nemo Mbridge Perf Activation Recompute skill enables selective or full recomputation of activations in Megatron Bridge, reducing GPU memory usage at the expense of additional compute. It is applied to mitigate out‑of‑memory errors or performance regressions related to recompute granularity, layer count, module selection, recompute method, or activation checkpointing. This capability benefits large‑scale training workflows that require efficient memory management while maintaining model accuracy.

Publisher / source
NVIDIA Skills (Verified)
Upstream record
NVIDIA/skills
Version
Version 3
Published
Publication review
Approved for publication
Content fingerprint
03379723143dfcd3cce4338c148fecc2aa515649ab85d3624e43a29b80f03e4e