Data Science & Analytics
Data Processing Nemo Curator
GPU-accelerated data curation for LLM training. Supports text/image/video/audio. Features fuzzy deduplication (16× faster), quality filtering (30+ heuristics), semantic deduplication, PII redaction, NSFW detection. Scales across GPUs with RAPIDS. Use for preparing high-quality training datasets, cleaning web data, or deduplicating large corpora.
- Publisher / source
- davila7/claude-code-templates (found on skills.sh)
- Upstream record
- davila7/claude-code-templates
- Version
- Version 9
- Published
- Publication review
- Approved for publication
- Content fingerprint
319a4e0d544453d5b70819e196cf116c4aee83906b5a7793e3c91116ec9e0219