high-quality Chinese training datasets
Collection
a suite of high-quality Chinese datasets, used for pretraining, fine-tuning or preference alignment. And the models trained on these datasets. • 13 items • Updated • 24
- Using
opencsg/csg-wukong-2b-chinese-fineweb-eduas base model, we fine-tune it onsmoltalk-chinesefor 2 epoch - learning rate = 3e-4 ; global batch size = 32 ; lr scheduler=cosine
- Downloads last month
- 5
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support