Wen Hu

From Transformer to Transponder: Introducing Contextual Modulation Training for Residual Learning in LLMs

Beyond Hard and Soft: Hybrid Context Compression for Balancing Local and Global Information Retention

CAKE: Cascading and Adaptive KV Cache Eviction with Layer Preferences