Xinrong Zhang

Stuffed Mamba: Oversized States Lead to the Inability to Forget

Stuffed Mamba: State Collapse and State Capacity of RNN-Based Long-Context Modeling

MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies

Predicting Emergent Abilities with Infinite Resolution Evaluation