Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution. Use when needing scalable evaluation on local Docker, Slurm HPC, or cloud platforms. NVIDIA's enterprise-grade platform with container-first architecture for reproducible benchmarking.
Install
npx skills add davila7/claude-code-templates --skill nemo-evaluator-sdknpx skills add davila7/claude-code-templates --skill nemo-evaluator-sdk -a claude-code -gnpx skills add davila7/claude-code-templates --skill nemo-evaluator-sdk -a codex -ggemini skills install https://github.com/davila7/claude-code-templates.git --path cli-tool/components/skills/ai-research/evaluation-nemo-evaluatorgh skill install davila7/claude-code-templates nemo-evaluator-sdkgit clone --depth 1 https://github.com/davila7/claude-code-templates /tmp/davila7__claude-code-templates
mkdir -p ~/.claude/skills ~/.agents/skills
cp -R /tmp/davila7__claude-code-templates/cli-tool/components/skills/ai-research/evaluation-nemo-evaluator ~/.claude/skills/nemo-evaluator-sdk # Claude Code
cp -R /tmp/davila7__claude-code-templates/cli-tool/components/skills/ai-research/evaluation-nemo-evaluator ~/.agents/skills/nemo-evaluator-sdk # Codex, Cursor, Gemini CLI, Copilot, OpenCode