Dayal Singh Kalra

Teaching Pretrained Language Models to Think Deeper with Retrofitted Recurrence

When Can You Get Away with Low Memory Adam?

(How) Can Transformers Predict Pseudo-Random Numbers?

Universal Sharpness Dynamics in Neural Network Training: Fixed Point Analysis, Edge of Stability, and Route to Chaos

Gradient-based Optimization of Dataset Mixtures