Yunhua Zhou

Explicit Multi-head Attention for Inter-head Interaction in Large Language Models

Evolution of Concepts in Language Model Pre-Training

Pre-Trained Policy Discriminators are General Reward Models

Towards Universality: Studying Mechanistic Similarity Across Language Model Architectures

Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance

BitStack: Any-Size Compression of Large Language Models in Variable Memory Environments

Implicit Reward as the Bridge: A Unified View of SFT and DPO Connections

GAOKAO-Eval: Does High Scores Truly Reflect Strong Capabilities in LLMs?