TokenToSeaSkill 广场
English 控制台

Benchmark Vllm Model

chalk-ai

Benchmark throughput and cost-per-token of a model served on vLLM in Chalk's container infrastructure. Use when someone asks for $/token, $/request, tokens/sec, "how much would it cost to self-host this model", GPU sizing for an LLM, or wants to compare a self-hosted model's economics against a hosted API.

安装

尚未确认此技能的独立目录。下面命令会打开仓库技能选择器,请按上游说明选择技能。

skills CLI
npx skills add chalk-ai/chalk-ai-plugins