Mohammad Shoeybi

Nemotron-CC-Math: A 133 Billion-Token-Scale High Quality Math Pretraining Dataset

AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergy

Music Flamingo: Scaling Music Understanding in Audio Language Models

UALM: Unified Audio Language Model for Understanding, Generation and Reasoning

RLP: Reinforcement as a Pretraining Objective

Front-Loading Reasoning: The Synergy between Pretraining and Post-Training Data

FusionFactory: Fusing LLM Capabilities with Multi-LLM Log Data

Prismatic Synthesis: Gradient-based Data Diversification Boosts Generalization in LLM Reasoning

Efficient Hybrid Language Model Compression through Group-Aware SSM Pruning

NV-Embed: Improved Techniques for Training LLMs as Generalist Embedding Models

AceReason-Nemotron: Advancing Math and Code Reasoning through Reinforcement Learning

MM-EMBED: UNIVERSAL MULTIMODAL RETRIEVAL WITH MULTIMODAL LLMS

MIND: Math Informed syNthetic Dialogues for Pretraining LLMs

ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities

LLM Pruning and Distillation in Practice