GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.
Install
npx skills add davila7/claude-code-templates --skill nemo-curatornpx skills add davila7/claude-code-templates --skill nemo-curator -a claude-code -gnpx skills add davila7/claude-code-templates --skill nemo-curator -a codex -ggemini skills install https://github.com/davila7/claude-code-templates.git --path cli-tool/components/skills/ai-research/data-processing-nemo-curatorgh skill install davila7/claude-code-templates nemo-curatorgit clone --depth 1 https://github.com/davila7/claude-code-templates /tmp/davila7__claude-code-templates
mkdir -p ~/.claude/skills ~/.agents/skills
cp -R /tmp/davila7__claude-code-templates/cli-tool/components/skills/ai-research/data-processing-nemo-curator ~/.claude/skills/nemo-curator # Claude Code
cp -R /tmp/davila7__claude-code-templates/cli-tool/components/skills/ai-research/data-processing-nemo-curator ~/.agents/skills/nemo-curator # Codex, Cursor, Gemini CLI, Copilot, OpenCode