Le Wu

MoSE: Decoupled Tuning for Forgetting-Resilient Multi-task Fine-tuning of LLMs

Recall-Extend Dynamics: Enhancing Small Language Models through Controlled Exploration and Refined Offline Integration

MORE: A MIXTURE OF LOW-RANK EXPERTS FOR ADAPTIVE MULTI-TASK LEARNING