AI Roleplay Fails As Poll Substitute

Updated: 2026.09.30 39MIN ago 1 sources
Pew’s prompt shows researchers can make a model ‘play’ a respondent by feeding profile and prior-answer JSON and by instructing the model to mimic human ignorance and biases. Even with careful prompts, synthetic respondents require many ad‑hoc constraints and still risk missing human-like nonresponse, uncertainty, and real-world reporting error. — If synthetic polling is imperfect, media, campaigns, and policymakers must treat AI-generated public-opinion data with caution because it can misrepresent uncertainty and diversity of views.

Sources

Appendix A: Model prompt text
Janakee Chavda 2026.09.30 100% relevant
Appendix A of the Pew report provides the exact prompt (PROFILE_JSON, RESPONSE_JSON, NEXT_QUESTION_JSON) and explicit instructions to constrain the model’s knowledge and behavior, showing both the method and its acknowledged limitations.
← Back to all ideas