Lin Chen

Shared Embedding Optimization: A Two-Stage Approach for Efficient and Effective Feature Embedding

Spark Transformer: Reactivating Sparsity in Transformer FFN and Attention

Bipartite Ranking From Multiple Labels: On Loss Versus Label Aggregation

Spark Transformer: How Many FLOPs is a Token Worth?

NanoMoE: Scaling Mixture of Experts to Individual Layers for Parameter-Efficient Deep Learning