Yongchang Hao

Cactus: Accelerating Auto-Regressive Decoding with Constrained Acceptance Speculative Sampling

Reward Model Boosting for RLHF

TokMem: One-Token Procedural Memory for Large Language Models

Radar: Fast Long-Context Decoding for Any Transformer

ULPT: Prompt Tuning with Ultra-Low-Dimensional Optimization

NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks