Extracting Parameter Counts from Fine-Tuning APIs

Sean Michael McLeish,Abhimanyu Hans,John Kirchenbauer,Yuxin Wen,Avi Schwarzschild,Jonas Geiping,Tom Goldstein

OpenReview PDF

提交: 2024-09-27更新: 2024-10-05

TL;DR

We show that access to a finetuning API is sufficient to extract the parameter count of the model behind the API.

摘要

关键词

large language modelsfinetuningsecurity

评审与讨论

撤稿通知

2024-10-05

During a re-analysis of our data we discovered that some of the metrics of fine-tuning runs were not recorded correctly. As a result, some figures and tables in this draft of the paper need to be revised. We will withdraw this version as we re-run the impacted trials, and we look forward to submitting a revised and corrected version of this paper to the next deadline.