John Yang

Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces

OpenThoughts: Data Recipes for Reasoning Models

Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration

MMTEB: Massive Multilingual Text Embedding Benchmark

LongCodeBench: Evaluating Coding LLMs at 1M Context Windows

EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilities

SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?