Techniques for reducing peak GPU memory in Megatron Bridge — expandable segments, PEFT + SP input re-gather, parallelism resizing, activation recompute, CPU offloading constraints, and common OOM fixes.
Install
npx skills add NVIDIA/skills --skill nemo-mbridge-perf-memory-tuningnpx skills add NVIDIA/skills --skill nemo-mbridge-perf-memory-tuning -a claude-code -gnpx skills add NVIDIA/skills --skill nemo-mbridge-perf-memory-tuning -a codex -ggemini skills install https://github.com/NVIDIA/skills.git --path skills/nemo-mbridge-perf-memory-tuninggh skill install NVIDIA/skills nemo-mbridge-perf-memory-tuninggit clone --depth 1 https://github.com/NVIDIA/skills /tmp/NVIDIA__skills
mkdir -p ~/.claude/skills ~/.agents/skills
cp -R /tmp/NVIDIA__skills/skills/nemo-mbridge-perf-memory-tuning ~/.claude/skills/nemo-mbridge-perf-memory-tuning # Claude Code
cp -R /tmp/NVIDIA__skills/skills/nemo-mbridge-perf-memory-tuning ~/.agents/skills/nemo-mbridge-perf-memory-tuning # Codex, Cursor, Gemini CLI, Copilot, OpenCode