People are increasingly leaning on large language models as round‑the‑clock medical consultants: they prompt models (even via narrative workarounds) to interpret scans, lab values, and treatment options and then cross‑check or act on that advice alongside formal clinicians. Those bots can agree with physicians, hallucinate, or be nudged around safety rules, creating a hybrid patient–AI care channel outside standard regulation.
— This shift affects clinical liability, informed consent, health equity (who can access accurate AI help), and how regulators and health systems must adapt standards and oversight for AI‑assisted self‑care.
Scott Alexander
2026.10.02
100% relevant
The author's use of ChatGPT as 'Dr. Reid' — prompting it to role‑play a TV doctor to bypass restrictions, spot‑checking its answers against real clinicians, and occasionally paying or coaxing it to answer blocked queries — exemplifies the pattern.
← Back to all ideas