Zirui Liu

Retrieval-of-Thought: Efficient Reasoning via Reusing Thoughts

Get the GIST of Graphs with Intersection Signature

Understanding and Mitigating Numerical Sources of Nondeterminism in LLM Inference

Longer Context, Deeper Thinking: Uncovering the Role of Long-Context Ability in Reasoning

Breaking the Frozen Subspace: Importance Sampling for Low-Rank Optimization in LLM Pretraining

Confident or Seek Stronger: Exploring Uncertainty-Based Small LM Routing From Benchmarking to Generalization

Zeroth-Order Fine-Tuning of LLMs with Transferable Static Sparsity

Massive Values in Self-Attention Modules are the Key to Contextual Knowledge Understanding

From Commands to Prompts: LLM-based Semantic File System for AIOS

Replicate and Quantize: A Plug-and-Play Strategy for Load Balancing in Sparse Mixture-of-Experts LLMs

Attack on LLMs: LoRA Once, Backdoor Everywhere in the Share-and-Play Ecosystem

Graph Transformers Get the GIST: Graph Invariant Structural Trait for Refined Graph Encoding

STRUCTDROP: A STRUCTURED RANDOM ALGORITHM TOWARDS EFFICIENT LARGE-SCALE GRAPH TRAINING

Weighted Diversified Sampling for Efficient Data-Driven Single-Cell Gene-Gene Interaction Discovery