The Utility of AI Tools in Auditing Adherence to Pre-Analysis Plans -- by Jeffrey Clemens, Anwita Mahajan
EconomicsHigher EducationData Science
THE AI ANGLE
Auditing adherence to pre-analysis plansResearchers Jeffrey Clemens and Anwita Mahajan demonstrated that large language models can efficiently and systematically audit adherence to pre-analysis plans by identifying design choices, evaluating deviations, and finding gaps in pre-specification. For faculty in economics and data science, this presents a scalable approach to improving research reproducibility and reducing manual labor, though variability across models highlights the continued necessity of human judgment.
THE TEACHING ANGLE
Instructors can explore the pedagogical tension between automating research integrity audits with AI and the ongoing need for human critical judgment due to variability in model outputs.Read the original at nber.org Generate teaching or study materials
More in Economics
- Europe must build own AI or risk getting cut off by US or China, says ECB’s LagardeThe Guardian — AI · September 15, 2026
- AI’s best coding agent fails 60% of the time — and the data backs it upThe New Stack · September 15, 2026
- AI, Redistribution, and the Size of the PieMarginal Revolution · September 15, 2026
- A costly mistake? Report claims a third of employees fired due to AI will need to be rehired in the next few yearsTechRadar · September 15, 2026
- Exclusive: Paying for frontier AI models buys 4-month head start at 5x the costArs Technica · September 15, 2026