Banggu Wu

UltraMemV2: Memory Networks Scaling to 120B Parameters with Superior Long-Context Learning

Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling

Hyper-Connections