Kaiyuan Wang

Shared Embedding Optimization: A Two-Stage Approach for Efficient and Effective Feature Embedding

NanoMoE: Scaling Mixture of Experts to Individual Layers for Parameter-Efficient Deep Learning