Zixuan Gong

~Zixuan_Gong1

Mastering Syntax, Unlocking Semantics: A Mathematically Provable Two-stage Learning Process in Transformers

Towards Auto-Regressive Next-Token Prediction: In-context Learning Emerges from Generalization