Scaling Indic Pretraining: 2.8T Tokens and an Open Data Generation Pipeline

1 points | by porridgeraisin 9 hours ago