AI & Machine Learning
Nemo Mbridge Perf Memory Tuning
Techniques for reducing peak GPU memory in Megatron Bridge — expandable segments, PEFT + SP input re-gather, parallelism resizing, activation recompute, CPU offloading constraints, and common OOM fixes.
- Publisher / source
- NVIDIA Skills (Verified)
- Upstream record
- NVIDIA/skills
- Version
- Version 3
- Published
- Publication review
- Approved for publication
- Content fingerprint
3e40e553688d53b8d73b0759ad0f523a0791bf622015d34ee97f631ab617664c