A warning can be true and still become a business advantage.
Builders of high-leverage technologies may publicly affirm the danger of their own systems, then present themselves as the only actors capable of managing it. The confession sounds like accountability. Structurally, it can also absorb the critic’s authority and shape regulation around capabilities only the largest institutions can afford.
Fear then becomes more than a warning. It becomes a moat. Compliance costs exclude smaller actors. Opaque systems remain controlled by those who built them. The public is asked to trust restraint it cannot independently test.
This does not prove that every warning is manipulative, every safety rule protects incumbents, or every form of centralized control is unnecessary. Intent may be mixed. The test is the resulting architecture:
Who retains access? Who can audit the system? Who can stop deployment? Who bears the cost of compliance? Can outsiders challenge safety claims without the operator’s permission?
Safety must not become patronage. Separate the warning from the power to profit from it. Require independent audits, enforceable liability, public standards, meaningful external scrutiny, and authority to pause dangerous systems without relying on the owner’s consent. Match obligations to actual risk so oversight does not quietly become exclusion.
An institution may sincerely fear a danger and still gain power from how that danger is governed. The warning matters. So does who receives the keys.
