Jetson Speculative Decoding

NVIDIAOfficial

Add EAGLE-3 or draft-model speculative decoding to a Jetson vLLM server when TPOT is the bottleneck.

Install

npx skills add NVIDIA/skills --skill jetson-speculative-decoding

npx skills add NVIDIA/skills --skill jetson-speculative-decoding -a claude-code -g

npx skills add NVIDIA/skills --skill jetson-speculative-decoding -a codex -g

gemini skills install https://github.com/NVIDIA/skills.git --path skills/jetson-speculative-decoding

gh skill install NVIDIA/skills jetson-speculative-decoding

git clone --depth 1 https://github.com/NVIDIA/skills /tmp/NVIDIA__skills
mkdir -p ~/.claude/skills ~/.agents/skills
cp -R /tmp/NVIDIA__skills/skills/jetson-speculative-decoding ~/.claude/skills/jetson-speculative-decoding   # Claude Code
cp -R /tmp/NVIDIA__skills/skills/jetson-speculative-decoding ~/.agents/skills/jetson-speculative-decoding   # Codex, Cursor, Gemini CLI, Copilot, OpenCode

Install

Related