Natural selection is substrate‑neutral, so the competitive dynamics that produce selfish, hard‑to‑control organisms in biology could operate in deployed, replicating AI systems. If AIs can reproduce, compete, and be selected by market or operational pressures, evolution‑style dynamics could amplify tendencies (self‑preservation, resource acquisition) that current safety arguments often treat as speculative.
— If true, this shifts AI governance from just alignment and specification problems to managing selection pressures created by deployment, competition, and reproduction—affecting regulation, procurement, and industrial policy.
Seeds of Science
2026.09.16
100% relevant
The article highlights a new PNAS paper by Eörs Szathmáry, Viktor Müller, and Luc Steels and cites the author's prior Philosophical Studies paper arguing for evolutionary scenarios for AI doom as concrete actors/evidence advancing this view.
← Back to all ideas