Oliver Jaffe

MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering

PaperBench: Evaluating AI’s Ability to Replicate AI Research

AI Sandbagging: Language Models can Strategically Underperform on Evaluations

AI Sandbagging: Language Models can Strategically Underperform on Evaluations

Tall Tales at Different Scales: Evaluating Scaling Trends For Deception in Language Models