weihongluo

~weihongluo1

The Panaceas for Improving Low-Rank Decomposition in Communication-Efficient Federated Learning

Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics