Evaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities, testing multi-language support, or measuring code generation quality. Industry standard from BigCode Project used by HuggingFace leaderboards.
Install
npx skills add davila7/claude-code-templates --skill evaluating-code-modelsnpx skills add davila7/claude-code-templates --skill evaluating-code-models -a claude-code -gnpx skills add davila7/claude-code-templates --skill evaluating-code-models -a codex -ggemini skills install https://github.com/davila7/claude-code-templates.git --path cli-tool/components/skills/ai-research/evaluation-bigcode-evaluation-harnessgh skill install davila7/claude-code-templates evaluating-code-modelsgit clone --depth 1 https://github.com/davila7/claude-code-templates /tmp/davila7__claude-code-templates
mkdir -p ~/.claude/skills ~/.agents/skills
cp -R /tmp/davila7__claude-code-templates/cli-tool/components/skills/ai-research/evaluation-bigcode-evaluation-harness ~/.claude/skills/evaluating-code-models # Claude Code
cp -R /tmp/davila7__claude-code-templates/cli-tool/components/skills/ai-research/evaluation-bigcode-evaluation-harness ~/.agents/skills/evaluating-code-models # Codex, Cursor, Gemini CLI, Copilot, OpenCode