TokenToSeaSkill 广场
English 控制台

Serving Llms On Instinct

AMD

Serves AI models on AMD Instinct GPU hardware using vLLM. Use this skill whenever the user wants to run, serve, deploy, start, host, or launch a language model on an AMD GPU, AMD Instinct, MI300X, MI325X, MI350X, or MI355X. Also use when the user mentions vLLM on ROCm, vLLM on AMD, serving on HBM, or asks how to get a model running on AMD data center hardware.

安装

npx skills add amd/skills --skill serving-llms-on-instinct