Piotr Piękos

Huxley-G\"odel Machine: Human-Level Coding Agent Development by an Approximation of the Optimal Self-Improving Machine

Hyperbolic Residual Quantization: Discrete Representations for Data with Latent Hierarchies

The Early Bird Catches the Worm: A Positional Decay Reweighting Approach to Membership Inference in Large Language Models

All Life is Problem Creation: Learning to Generate Environments that Maximize Performance Gain

Mixture of Sparse Attention: Content-Based Learnable Sparse Attention via MoEs

SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention

Few Heads are Enough

Efficient Value Propagation with the Compositional Optimality Equation