Liangyu Huo

~Liangyu_Huo1

How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider and MoE Transformers

MoGU: A Framework for Enhancing Safety of LLMs While Preserving Their Usability