Jonathan Hayase

Sampling from Your Language Model One Byte at a Time

Are you going to finish that? A Practical Study of the Tokenization Boundary Problem

OML: A Primitive for Reconciling Open Access with Owner Control in AI Model Distribution

SuperBPE: Space Travel for Language Models

Scalable Fingerprinting of Large Language Models

Broken Tokens? Your Language Model can Secretly Handle Non-Canonical Tokenizations

Scalable Extraction of Training Data from Aligned, Production Language Models