TokenToSeaSkills Hub
中文 Console

Serving Llms Vllm

NousResearch

vLLM: high-throughput LLM serving, OpenAI API, quantization.

Install

npx skills add NousResearch/hermes-agent --skill serving-llms-vllm