TokenToSeaSkills Hub
中文 Console

Jetson Llm Serve

NVIDIAOfficial

Stand up vLLM or SGLang serving on Jetson, using upstream vLLM on Thor and Orin JetPack 7.2+, and NVIDIA-AI-IOT vLLM on older Orin.

Install

npx skills add NVIDIA/skills --skill jetson-llm-serve