Chaoyi Zhang

Scaling Law for Quantization-Aware Training

Ctrl-Z Sampling: Diffusion Sampling with Controlled Random Zigzag Explorations

HSA: Head-wise Sparse Attention for Efficient and Accurate Long-context Inference

INT v.s. FP: A Comprehensive Study of Fine-Grained Low-bit Quantization Formats

Model Merging in Pre-training of Large Language Models