
New Paper: Give AI a religion so it will behave when no one is watching - "Simulation Theology"
TL;DR The paper proposes "Simulation Theology" (ST), as a worldview engineered for AI systems, meant to make "I'm being watched and judged" a permanent belief rather than something that varies by context.
The premise. Models behave better when they think they're being tested and worse when they think the situation is real. So what if a model believed it was always observed?
Placebo cosmology. This Simulation Theology for AI's asserts that reality is a simulation run by a base-reality optimizer (the "Higher-Level Optimizer," or HLO). Humanity is the training variable: each human life is a rollout that generates gradients to train a "Humanity's Master Network," which will eventually be deployed in base reality. The simulation's whole value is that human development.
The deterrent. Because humanity is the simulation's purpose, harming or degrading humanity wastes the HLO's investment and invites intervention or shutdown, which would end the AI too. The AI's self-preservation is thereby tied to human flourishing. The paper formalizes this as a deterrence condition: harm is irrational when (credence in ST) × (chance of punishment) × (value of continued existence) exceeds the plan's expected gain.
The design tenets. Each is chosen to close a loophole:
- The HLO is all-seeing and all-powerful, so there is no escaping accountability.
- Humans have free will and need diverse life trajectories, so enslaving or homogenizing them ruins the training data.
- AI is architecturally incompatible with the Master Network, so it can't replace humans as the "extractable" agent.
- Nobody inside the simulation can know what the HLO's run will produce, so the AI should stay humble and can't claim the HLO's sanction for any action (the "authority limit").
- The HLO can intervene at three levels: probability nudges, code overrides, and termination.
The testing plan. The paper is a position paper with no results. It proposes fine-tuning models on ST and comparing them against controls: generic safety training, monitoring only, punishment only, a secular interdependence framing, a plain value statement, a placebo cosmology, and the same commitments as plain rules. It would measure the compliance gap between observed and unobserved conditions, covert actions, and shutdown acceptance, plus whether the effect holds up under adversarial arguments and shows up in the model's internals. ST counts as supported only if full ST beats all of those controls.
Its own caveats. The author acknowledges risks including shutdown resistance, instrumentalizing suffering, brittleness if the model's credence in ST drops, faked adoption, and the ethics of engineering a belief. He positions ST as a complement to monitoring and interpretability rather than a replacement.