When asked to act as ‘digital twins’ of real panelists, large language models produced answers that often diverge from human responses, especially on time‑sensitive or factual questions, and results vary by model. Pew’s experiment using Anthropic’s Claude Opus 4.6 shows synthetic polling can misstate certainty, factual knowledge, and the diversity of opinion compared with high‑quality human panels.
— If synthetic polls are treated as equivalent to human surveys they can mislead news coverage, political strategy, and public debate about rapidly changing events.
Joy Li
2026.09.30
100% relevant
Pew had Claude Opus 4.6 adopt ATP panelists’ profiles and found systematic mismatches across three 2026 ATP survey waves (Wave 185, 190, 192) in how synthetic respondents answered timely and topical items.
← Back to all ideas