NVIDIA GPU-accelerated data generation pipeline
AssessTools
An open, GPU-accelerated workflow for translation, quality checks, and text repair.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by open-source activity, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 8Hugging Face Blog·10/16/2026open_sourceNVIDIA and AI4Bharat release 2.8 trillion-token Indic pretraining corpus
NVIDIA and AI4Bharat are introducing Nemotron-pretraining-Indic-v1, a large corpus of about 2.8 trillion tokens across 22 Indian languages, along with an open GPU-accelerated pipeline used to generate it. The release includes native-script data for all 22 languages, romanized text for 12, and workflows for translation, quality assessment, and repair to help developers build better Indic-language models.