Shuohang Wang

DenseMixer: Improving MoE Post-Training with Precise Router Gradient

Reinforcement Learning for Reasoning in Large Language Models with One Training Example

Routing Mamba: Scaling State Space Models with Mixture-of-Experts Projection

Decoder-Hybrid-Decoder Architecture for Efficient Reasoning with Long Generation

LoRC: Low-Rank Compression for LLMs KV Cache with a Progressive Compression Strategy

Self-Exploring Language Models: Active Preference Elicitation for Online Alignment