Replication Rates as Science Confidence Meter

Updated: 2026.04.16 3D ago 4 sources
Large, coordinated replication projects should be treated as a routine, auditable metric of a field's reliability. Regularly reporting field-level replication rates and typical effect‑size decay would give funders, journals, and the public a concrete signal about how much confidence to place in new findings. — Making replication rates public would reorient incentives in science (publishing, hiring, funding) and sharpen public understanding of what scientific claims are well‑established versus provisional.

Sources

What Akbari’s Reply Gets Wrong About Science
Davide Piffer 2026.04.16 85% relevant
The article is a dispute over prior evidence and replication claims in ancient‑DNA polygenic‑score work: Piffer documents earlier West and East Eurasian time‑series findings (Mar 2024, Jan 30 2025) that overlap with Akbari et al.’s West Eurasia paper (preprint Sept 2024; Nature 15 Apr 2026), turning what might be a methodological debate into a replication/priority question that affects how confident the community and the public should be about directional‑selection claims.
Thursday assorted links
Tyler Cowen 2026.04.02 80% relevant
Cowen links to new results on reproducibility and a visual comparing fields (calling out Education as weak), which is direct empirical evidence feeding the broader idea that replication rates should be used as a signal of scientific confidence and policy caution.
~75% of Psychology Claims are False - by Lee Jussim
2026.03.05 90% relevant
Jussim anchors his ~75% estimate on replication failure rates (he cites an unreplicable‑finding run rate of ~50%) and then adds concrete channels (misquotation, ignoring contrary evidence, fabrication, censorship) that convert replication gaps into a broader proportion of false claims — this is exactly the argument that replication statistics should be treated as a core measure of how much to trust scientific fields.
PSYCHOLOGY. Estimating the reproducibility of psychological science - PubMed
2015.03.05 100% relevant
Open Science Collaboration's 2015 Science paper: 100 attempted replications in psychology with only ~36% statistically significant and large average reductions in effect size.
← Back to All Ideas