TokenToSeaSkill 广场
English 控制台

Jetson Llm Serve

NVIDIA官方

Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.

安装

npx skills add NVIDIA/skills --skill jetson-llm-serve