Petar Veličković

Affiliated Lecturer@University of Cambridge·英国·OpenReview

研究方向

geometric deep learning · algorithmic reasoning · graph neural networks · graph convolutions · bioinformatics · biomedical data · multimodal deep learning · cross-modality · deep learning · CNNs · computer vision · small datasets · sparse datasets

Petar Veličković

Wavelet-Induced Rotary Encodings: RoPE Meets Graphs

Mastering Board Games by External and Internal Planning with Language Models

Why do LLMs attend to the first token?

Positional Attention: Expressivity and Learnability of Algorithmic Computation

What Makes a Good Feedforward Computational Graph?

softmax is not enough (for sharp out-of-distribution)

Round and Round We Go! What makes Rotary Positional Encodings useful?

Softmax is not Enough (for Sharp Size Generalisation)

Transformers meet Neural Algorithmic Reasoners

Positional Attention: Out-of-Distribution Generalization and Expressivity for Neural Algorithmic Reasoning

Temporal Graph Rewiring with Expander Graphs