Noah Amsel

The Polar Express: Optimal Matrix Sign Methods and their Application to the Muon Algorithm

Customizing the Inductive Biases of Softmax Attention using Structured Matrices

Quality over Quantity in Attention Layers: When Adding More Heads Hurts

Compositional Reasoning with Transformers, RNNs, and Chain of Thought