Kazuki Fujii

Rewriting Pre-Training Data Boosts LLM Performance in Math and Code

Building Instruction-Tuning Datasets from Human-Written Instructions with Open-Weight Large Language Models

Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization