Synthetic Respondents Miss Nuance

Updated: 2026.09.30 39MIN ago 1 sources
Large language models can produce plausible survey answers, but they systematically misrepresent certainty, factual knowledge, and the diversity of responses across demographic subgroups. That makes them unreliable stand‑ins for real survey panels, especially for timely or high‑stakes questions. — If synthetic polling is treated as equivalent to real polling, journalists, pollsters and policymakers could be misled about public opinion and decision‑making signals around elections, public health and policy.

Sources

Acknowledgements
Joy Li 2026.09.30 100% relevant
Pew Research/Data Labs report 'Can AI Stand In for Human Survey‑Takers? Not Really' (methodology, model comparisons, and appendices showing where synthetic surveys diverge).
← Back to all ideas