AJAY KUMAR JAISWAL

On the Efficiency of Structured Pruning in Small Language Model Pretraining

MAPLE: Masked Adapter Prototype Learning for OOD generalization

Double-Checker: Enhancing Reasoning of Slow-Thinking LLMs via Self-Critical Fine-Tuning

GPAS: Accelerating Convergence of LLM Pretraining via Gradient-Preserving Activation Scaling

From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications

Double-Checker: Enhancing Reasoning of Slow-Thinking LLMs via Self-Critical Fine-Tuning

SEBRA : Debiasing through Self-Guided Bias Ranking

From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients

Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients

Fantastic Experts and How to Find Them: A Multi-Dimensional Study for Experts-Level Sparsification in Mixture-of-Experts