Fit a Datadog LLM-Obs evaluator to human labels. Takes an annotation queue, works out where in the trace the labelled property actually lives, drafts an LLM-judge that predicts the human label, scores that judge against the already-labelled rows with a metric agreed with the user, then hill-climbs it — inspect the errors, make one focused change, re-score, keep it only if it beats the best — for…
安装
npx skills add datadog-labs/agent-skills --skill agent-observability-build-eval-from-annotationsnpx skills add datadog-labs/agent-skills --skill agent-observability-build-eval-from-annotations -a claude-code -gnpx skills add datadog-labs/agent-skills --skill agent-observability-build-eval-from-annotations -a codex -ggemini skills install https://github.com/datadog-labs/agent-skills.git --path agent-observability/agent-observability-build-eval-from-annotationsgh skill install datadog-labs/agent-skills agent-observability-build-eval-from-annotationsgit clone --depth 1 https://github.com/datadog-labs/agent-skills /tmp/datadog-labs__agent-skills
mkdir -p ~/.claude/skills ~/.agents/skills
cp -R /tmp/datadog-labs__agent-skills/agent-observability/agent-observability-build-eval-from-annotations ~/.claude/skills/agent-observability-build-eval-from-annotations # Claude Code
cp -R /tmp/datadog-labs__agent-skills/agent-observability/agent-observability-build-eval-from-annotations ~/.agents/skills/agent-observability-build-eval-from-annotations # Codex, Cursor, Gemini CLI, Copilot, OpenCode