Zeyuan Allen-Zhu

Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers

Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws

Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problems

Physics of Language Models: Part 3.2, Knowledge Manipulation

Interpretability of Language Models for Learning Hierarchical Structures

Physics of Language Models: Part 2.1, Grade-School Math and the Hidden Reasoning Process

Reverse Training to Nurse the Reversal Curse

Knowledge Storage and Extraction in Language Models (Part A)

Knowledge Manipulation in Language Models (Part B)

How Language Models Learn Context-Free Grammars