Yuan Cao

TAH-QUANT: Effective Activation Quantization in Pipeline Parallelism over Slow Network

Improving MoE Performance and Efficiency with Plug-and-Play Intra-Layer Specialization and Cross-Layer Coupling Losses