TokenToSeaSkill 广场
English 控制台

Jetson Speculative Decoding

NVIDIA官方

Add EAGLE-3 or draft-model speculative decoding to a Jetson vLLM server when TPOT is the bottleneck.

安装

npx skills add NVIDIA/skills --skill jetson-speculative-decoding