Radu State

Geometric Analysis of Token Selection in Multi-Head Attention

Are Small Language Models the Silver Bullet to Low-Resource Languages Machine Translation?

Limitations of Normalization in Attention