Li Du

BASE-Q: Bias and Asymmetric Scaling Enhanced Rotational Quantization for Large Language Models

Lifted Uniform Quantization for Extreme Low-bit Large Language models

T-REX: Mixture-of-Rank-One-Experts with Semantic-aware Intuition for Multi-task Large Language Model Finetuning

Efficient and Quantization-Friendly Ternary Fourier Convolution Algorithms

PromptCoT: Align Prompt Distribution via Adapted Chain-of-Thought