Boris Shaposhnikov

The Differences Between Direct Alignment Algorithms are a Blur

ESSA: Evolutionary Strategies for Scalable Alignment

PRPO: Collaborative Online Policy Learning in Personalized RLHF

Small Vectors, Big Effects: A Mechanistic Study of RL-Induced Reasoning via Steering Vectors

Learn Your Reference Model for Real Good Alignment