Guidance for optimizing LLM inference request batching and scheduling problems. This skill applies when designing batch schedulers that minimize cost while meeting latency and padding constraints, involving trade-offs between batch count, shape selection, and padding ratios.
Install
npx skills add benchflow-ai/skillsbench --skill llm-inference-batching-schedulernpx skills add benchflow-ai/skillsbench --skill llm-inference-batching-scheduler -a claude-code -gnpx skills add benchflow-ai/skillsbench --skill llm-inference-batching-scheduler -a codex -ggemini skills install https://github.com/benchflow-ai/skillsbench.git --path registry/terminal_bench_2.0/letta_skills_batch/terminal_bench_2_0_llm-inference-batching-scheduler/environment/skills/llm-inference-batching-schedulergh skill install benchflow-ai/skillsbench llm-inference-batching-schedulergit clone --depth 1 https://github.com/benchflow-ai/skillsbench /tmp/benchflow-ai__skillsbench
mkdir -p ~/.claude/skills ~/.agents/skills
cp -R /tmp/benchflow-ai__skillsbench/registry/terminal_bench_2.0/letta_skills_batch/terminal_bench_2_0_llm-inference-batching-scheduler/environment/skills/llm-inference-batching-scheduler ~/.claude/skills/llm-inference-batching-scheduler # Claude Code
cp -R /tmp/benchflow-ai__skillsbench/registry/terminal_bench_2.0/letta_skills_batch/terminal_bench_2_0_llm-inference-batching-scheduler/environment/skills/llm-inference-batching-scheduler ~/.agents/skills/llm-inference-batching-scheduler # Codex, Cursor, Gemini CLI, Copilot, OpenCode