Nicolas Zucchet

The emergence of sparse attention: impact of data distribution and benefits of repetition

How do language models learn facts? Dynamics, curricula and hallucinations

On the interplay between learning and memory in deep state space models

Gated recurrent neural networks discover attention

Recurrent neural networks: vanishing and exploding gradients are not the end of the story