Hanlin Zhang

Discovering Hierarchical Latent Capabilities of Language Models via Causal Representation Learning

Connections between Schedule-Free Optimizers, AdEMAMix, and Accelerated SGD Variants

EvoLM: In Search of Lost Language Model Training Dynamics

Mind the Gap: Examining the Self-Improvement Capabilities of Large Language Models

How Does Critical Batch Size Scale in Pre-training?

Follow My Instruction and Spill the Beans: Scalable Data Extraction from Retrieval-Augmented Generation Systems

Eliminating Position Bias of Language Models: A Mechanistic Approach