TokenToSeaSkills Hub
中文 Console

Serving Llms On Instinct

AMD

Serves AI models on AMD Instinct GPU hardware using vLLM. Use this skill whenever the user wants to run, serve, deploy, start, host, or launch a language model on an AMD GPU, AMD Instinct, MI300X, MI325X, MI350X, or MI355X. Also use when the user mentions vLLM on ROCm, vLLM on AMD, serving on HBM, or asks how to get a model running on AMD data center hardware.

Install

npx skills add amd/skills --skill serving-llms-on-instinct