Si Wei

MoSE: Decoupled Tuning for Forgetting-Resilient Multi-task Fine-tuning of LLMs

How Does Sequence Modeling Architecture Influence Base Capabilities of Pre-trained Language Models? Exploring Key Architecture Design Principles to Avoid Base Capabilities Degradation