Alycia Lee

Beyond Scale: The Diversity Coefficient as a Data Quality Metric for Variability in Natural Language Data

Beyond Scale: the Diversity Coefficient as a Data Quality Metric Demonstrates LLMs are Pre-trained on Formally Diverse Data