ArXiv has announced a new policy requiring authors to verify content generated by large language models, imposing a one-year ban and additional peer-review requirements on authors whose submissions contain evidence they did not check LLM output. The policy was announced by Thomas Dietterich, chair of arXiv's computer science section, in a thread on X that was also screenshotted on Bluesky.

Under the policy, if a submission contains evidence that authors did not verify LLM-generated content, the authors will face a one-year ban from the repository. After that period, subsequent submissions must first be accepted by a reputable peer-reviewed venue before they can be posted.

"If a submission contains incontrovertible evidence that the authors did not check the results of LLM generation, this means we can't trust anything in the paper," Dietterich said. Evidence cited as demonstrating a failure to check generated results includes hallucinatory references and comments to or from an LLM left in the text.

The policy does not prohibit the use of large language models. It requires authors to take full responsibility for the content of their submissions irrespective of how it was generated. Researchers who directly copy-paste inappropriate language, plagiarized content, biased content, errors, incorrect references, or misleading content from an LLM remain responsible for that content.

Dietterich told 404 Media that the policy will operate on a one-strike basis. Moderators must flag issues and section chairs must confirm the evidence before penalties are imposed, and authors will be able to appeal decisions on their submissions.

ArXiv is an open repository for preprint research widely used by researchers to circulate work in computer science and mathematics. First-time posters have been required to obtain an endorsement from an established author before submitting. After being hosted by Cornell University for more than 20 years, arXiv is becoming an independent nonprofit.

Fake citations, unedited prompt responses, and nonsensical diagrams have appeared in peer-reviewed literature. Recent peer-reviewed research has found that fabricated citations are on the rise in biomedical research. Dietterich is an emeritus professor at Oregon State University and serves on arXiv's editorial advisory council and on its moderation team.