Validates dataset formatting and quality for SageMaker model fine-tuning (SFT, DPO, or RLVR). Use when the user says "is my dataset okay", "evaluate my data", "check my training data", "I have my own data", or before starting any fine-tuning job. Detects file format, checks schema compliance against the selected model and technique, and reports whether the data is ready for training or evaluation.
Install
npx skills add awslabs/agent-plugins --skill dataset-evaluationnpx skills add awslabs/agent-plugins --skill dataset-evaluation -a claude-code -gnpx skills add awslabs/agent-plugins --skill dataset-evaluation -a codex -ggemini skills install https://github.com/awslabs/agent-plugins.git --path plugins/sagemaker-ai/skills/dataset-evaluationgh skill install awslabs/agent-plugins dataset-evaluationgit clone --depth 1 https://github.com/awslabs/agent-plugins /tmp/awslabs__agent-plugins
mkdir -p ~/.claude/skills ~/.agents/skills
cp -R /tmp/awslabs__agent-plugins/plugins/sagemaker-ai/skills/dataset-evaluation ~/.claude/skills/dataset-evaluation # Claude Code
cp -R /tmp/awslabs__agent-plugins/plugins/sagemaker-ai/skills/dataset-evaluation ~/.agents/skills/dataset-evaluation # Codex, Cursor, Gemini CLI, Copilot, OpenCode