Zhijie Wang

On the Effect of Positional Encoding for In-context Learning in Transformers

In-Context Stochastic Gradient Descent with Hybrid Mamba-2 and Linear Self-Attention Model

RaSA: Rank-Sharing Low-Rank Adaptation