Ping Guo

Token Alignment Heads: Unveiling Attention's Role in LLM Multilingual Translation

LayerMix Law: Scaling Law for Large Language Models on Quality-Weighted Mixture Data with Repetition

From Translation to Multilinguality: Revisit the Role of Parallel Data in Multilingual LLM Pretraining

ParaRater: Enhancing Cross-Lingual Transfer in Large Langauge Models with Meta-Learning

MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining

Exploring Polyglot Harmony: On Multilingual Data Allocation for Large Language Models Pretraining