Data Science & Analytics

Data Processing Nemo Curator

GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.

Publisher / source
davila7/claude-code-templates (found on skills.sh)
Upstream record
davila7/claude-code-templates
Version
Version 9
Published
Publication review
Approved for publication
Content fingerprint
319a4e0d544453d5b70819e196cf116c4aee83906b5a7793e3c91116ec9e0219