Ziqing Xu

LoRA Provably Reduces Forgetting and Enables Adapter Merging in Multiclass Linear Classification

Softmax-Induced Ill-Conditioning in Transformer Models

Convergence Rates for Gradient Descent on the Edge of Stability for Overparametrised Least Squares

Gradient Descent and Attention Models: Challenges Posed by the Softmax Function