Pre-training
AssessTechniques
The initial training phase where a model learns broad patterns from large-scale data before fine-tuning.
Why it's here
Placed in Assess: 1 article(s) of evidence from 1 source(s), led by research breakthroughs, with 1 in the last 30 days. Confidence 24%. Low accumulated evidence, so it defaults conservatively pending more signal.
Evidence (1)
- 8Ars Technica AI·8/7/2026breakthroughByteDance trains a giant AI model to challenge top US labs
ByteDance is reportedly training an AI model with up to 10 trillion parameters, potentially putting it in the same class as Anthropic’s most advanced systems. The model is still in pre-training, and the final size may change before any fine-tuning or release.