Tianyu Gao

LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation

Metadata Conditioning Accelerates Language Model Pre-training

HELMET: How to Evaluate Long-context Models Effectively and Thoroughly

How to Train Long-Context Language Models (Effectively)

Evaluating Large Language Models at Evaluating Instruction Following

Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning