Don't Trust Single Psychology Papers

Updated: 2026.09.16 5H ago 3 sources
Published claims in psychology should be treated as provisional until multiple independent replications confirm them; Lee Jussim argues that replication failures and downstream misuse mean a large share of published psychological claims are likely false. The policy and media implication is that single studies should not drive public policy, high‑profile reporting, or educational curricula without corroboration. — If adopted, this precautionary stance would shift how journalists, policymakers, and educators cite psychological research, reducing policy mistakes based on fragile findings.

Sources

Frequencies & Whole Objects
Rob Kurzban 2026.09.16 72% relevant
The article emphasizes how presentation and method (frequencies vs percentages) change reasoning outcomes, underscoring the existing idea that single psychology findings must be interpreted in context and that procedural details (how results are framed and operationalized) drive real‑world impact; the mammography example concretely shows methodological framing determines public comprehension.
Tuesday assorted links
Tyler Cowen 2026.05.05 60% relevant
Tyler Cowen's link noting 'Rachel Glennerster defends RCTs in development economics' connects directly to the methodological debate this idea tracks: whether single high‑profile randomized controlled trials (RCTs) should be taken as decisive evidence or treated cautiously in light of replication and incentives; Glennerster (actor) defending RCTs is a concrete prompt for that discourse.
~75% of Psychology Claims are False - by Lee Jussim
2026.05.04 100% relevant
Lee Jussim's essay claims an empirical run rate of unreplicable findings around 50% and uses that (plus secondary mechanisms) to estimate ~75% of psychology literature claims are false.
← Back to all ideas