Yao Lu

Locality-aware Parallel Decoding for Efficient Autoregressive Image Generation

LongLive: Real-time Interactive Long Video Generation

StreamingVLM: Real-Time Understanding for Infinite Video Streams

QeRL: Beyond Efficiency - Quantization-enhanced Reinforcement Learning for LLMs

3D Aware Region Prompted Vision Language Model

OmniVinci: Enhancing Architecture and Data for Omni-Modal Understanding LLM

EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videos

SANA: Efficient High-Resolution Text-to-Image Synthesis with Linear Diffusion Transformers

Scaling RL to Long Videos

HART: Efficient Visual Generation with Hybrid Autoregressive Transformer

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generation

COAT: Compressing Optimizer states and Activations for Memory-Efficient FP8 Training

X-VILA: Cross-Modality Alignment for Large Language Models

Wolf: Accurate Video Captioning with a World Summarization Framework

VILA^2: VLM Augmented VLM with Self-Improvement