James B Simon

Predicting Kernel Regression Learning Curves from Only Raw Data Statistics

Saddle-To-Saddle Dynamics in Deep ReLU Networks: Low-Rank Bias in the First Saddle Escape

FACT: a first-principles alternative to the Neural Feature Ansatz for how networks learn representations

Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models

Alternating Gradient Flows: A Theory of Feature Learning in Two-layer Neural Networks

The Optimization Landscape of SGD Across the Feature Learning Strength