AI Tools Join Peer Review

Updated: 2026.05.04 1M ago 2 sources
Economics journals are piloting Refine, an AI that scans papers and appendices for mistakes; its creators say it found problems in roughly a third of already‑refereed papers. If adopted widely, such tools could change referee workloads, raise the bar for reproducibility, and shift editorial responsibility toward automated checks. — Widespread use of AI in peer review would reshape scientific credibility, publication incentives, and how errors or 'sloppiness' are discovered and punished across disciplines.

Sources

Political Psychology Links, 5/4/2026
Arnold Kling 2026.05.04 60% relevant
Kling discusses assigning an AI project to score opinion writing and Scott Alexander questions whether users will adopt platforms that privilege logical accuracy — this concretely connects to debates about using AI to automate evaluation and moderation (peer‑review/adjudication) of public discourse.
Is AI currently helping economic research?
Tyler Cowen 2026.03.19 100% relevant
Refine (AI reviewing tool) being trialed by several top‑five economics journals and Ben Golub’s statement that Refine found issues in at least one‑third of cases.
← Back to all ideas