The people who first see a dangerous training run are usually inside the lab, under NDAs, watching a launch calendar. Whistleblower protection is how those people become a warning system instead of a silence system. Until outside inspectors exist, insiders are the smoke detectors.

Frontier AI researchers have a vantage point no regulator or inspector currently matches, and they are frequently bound by contracts and non-disparagement clauses that make speaking out costly or career-ending. Protecting their ability to warn is one of the most tractable and underrated levers in ASI governance.

Why insiders matter so much for AI

Frontier AI has an unusual transparency problem. The most consequential decisions, how a model is trained, what safety testing it received, what worrying behaviors emerged, whether warnings were overruled, happen inside private organizations, invisible to outsiders. Regulators lack the access and often the expertise to see them independently. In this environment, the researchers and engineers with direct knowledge are the only people positioned to detect and report that something has gone wrong before it becomes public in the worst way.

This concern is not hypothetical. In 2024 a group of current and former employees of leading AI companies published an open letter, 'A Right to Warn about Advanced Artificial Intelligence', arguing that confidentiality agreements were blocking them from raising safety concerns and calling for protections to allow it. That such a letter was necessary is itself evidence of the problem: the people closest to the risk felt legally and professionally unable to talk about it.

What is blocking them

  • Restrictive agreements. Broad confidentiality and non-disparagement clauses (sometimes tied to vested equity worth millions) can make speaking out financially ruinous.
  • Legal exposure. Without a clear protected channel, an employee who discloses concerns risks being sued for breach of contract or trade-secret violation.
  • Gaps in existing law. Traditional whistleblower statutes protect reports of illegal activity, but much of what is dangerous in frontier AI is not yet illegal, leaving disclosures about lawful-but-reckless development unprotected.
  • Career risk. In a small field, the informal cost of being seen as disloyal can end a career even where formal retaliation is barred.

What effective protection would look like

1

Protected disclosure channels

Legally guaranteed routes for AI workers to report safety concerns to a regulator or oversight body, shielded from liability, even when the conduct disclosed is not itself illegal.

2

Limits on silencing contracts

Restrictions on the use of confidentiality and non-disparagement clauses to suppress good-faith safety concerns, so that reporting a danger cannot cost an employee their vested compensation.

3

Anti-retaliation guarantees

Strong, enforceable protection against dismissal, blacklisting, or other retaliation for protected disclosures, with real remedies.

4

A body to receive warnings

An oversight authority (a regulator or safety institute) with the mandate and expertise to act on disclosures rather than let them disappear.

Until we can inspect the labs from the outside, the people inside them are our smoke detectors. A law that lets a company silence its own researchers about a catastrophic risk is a law that disables the alarm.

Tractable, and a bridge to more

Whistleblower protection has a rare quality in ASI governance: it is achievable through ordinary domestic legislation, without a treaty, without international consensus, and without resolving the hard questions of thresholds and verification. Any jurisdiction that hosts frontier labs can enact it unilaterally, and doing so would immediately strengthen the world's ability to detect dangerous development. It is also a bridge to harder governance: the protected disclosures it enables generate exactly the kind of inside information that regulators and, eventually, an international verification regime would rely on. Building external verification will take years. Protecting the insiders who can warn us in the meantime is something legislatures can do now, and it is among the highest-leverage safety measures available before a treaty exists.