Le-Trung Nguyen

Efficient Resource-Constrained Training of Transformers via Subspace Optimization

Beyond Low-rank Decomposition: A Shortcut Approach for Efficient On-Device Learning