Two Stories in Understanding Arithmetic Learning at Scale

Chunyuan Deng,Zhiqi Li,Roy Xie,Ruidi Chang,Hanjie Chen

提交: 2024-09-28更新: 2024-10-12

TL;DR

We find that language models perform arithmetic learning in a pure symbolic way, and we further provide a holistic framework to understand how.

摘要

关键词

Math ArithmeticMechanistic UnderstandingLarge Language Models

评审与讨论

撤稿通知

2024-10-12

We found comments that were unintentionally left uncommented in the main body of the text. Although this does not change our major conclusions and insights, it may violate the double-blind policy of ICLR. Therefore, we have decided to withdraw this version and we apologize for any inconvenience this may cause.