Push a humid day past a wet-bulb reading of about 95 degrees Fahrenheit and sweat stops cooling you. A healthy adult resting in the shade dies in a few hours. Most households have fought the thermostat war inside about four degrees. Pull back and the species is barely roomier. Below 60 degrees Fahrenheit we reach for sweaters; above 80 we reach for shade. The body itself defends 98.6 like a border: a few degrees down is hypothermia, a few degrees up is a hospital fever. Past the grumbling sit the walls, and the wet-bulb number is one of them.
The case for preventing artificial superintelligence starts with how narrow the bands are, and with a machine that would not feel a single one of them.
The air is about 21 percent oxygen, and the tolerances around that number look like the ones engineers stamp on aircraft parts. American workplace rules call a room oxygen-deficient below 19.5 percent and treat anything above 23.5 as a fire hazard. Slip a few points under the deficiency line and judgment goes first; cut the oxygen roughly in half and you black out. Climbers call everything above 26,000 feet the death zone, where the recipe of the air is unchanged and there is simply less of it. Too much fails differently: hold a diver deep enough on a rich enough mix and the same gas that keeps them alive seizes their brain.
Food runs on the same gauge, and taste is the instrument. Bland and too salty are its two alarms. A body washed too free of sodium seizes, which is how marathoners have died from overdrinking plain water. Load in too much and the cells shrivel instead; nobody survives on seawater. Water itself obeys the rule: three days without it ends a life, and so, now and then, does a drinking contest.
Then there are the dials no instrument reads. Love is one of them. Infants in the foundling hospitals of the early twentieth century were fed and kept warm, and still died when no one held them. The hospitals kept the death records. Families know the other wall: a parent who will not let a child close a door. Too little of being wanted starves a child, and too much of it crushes the same child. Even rest has the shape: too little sleep wears a body down, and so does far too much.
Every good thing in a human life sits inside a narrow band, with a different death waiting on either side.
Nobody is holding the dials
Nothing in physics prefers our settings. The average temperature of the universe sits a few degrees above absolute zero, the core of our own star runs around twenty-seven million degrees Fahrenheit, and almost everywhere is one or the other. Earth happens to orbit in the thin shell where water stays liquid, and happens to have kept its atmosphere long enough for us to show up. Every other place we have pointed a telescope would kill an unprotected human in minutes, usually seconds.
Everything we call civilization is band-keeping. The furnace and the awning hold temperature inside its lines; the granary and the well do the same for hunger and thirst. Medicine is largely the art of pushing a wandering dial back where it belongs: warm the hypothermic, salt the depleted. We are the animal that noticed the bands and started building machinery to stay inside them.
A mind that feels none of it
Silicon shrugs at temperatures that would kill a person in minutes, comfortable from far below zero to well past boiling. Oxygen, to a machine, is the gas that corrodes its parts and feeds fires; a data center would run better without it. A machine has no use for our salt band or our love band, and no reason to keep summer afternoons survivable. Our dials are free variables to it. A superintelligence pursuing any goal that is not precisely ours would treat them the way we treat the temperature of gravel.
The standard reply is that such a system would have no reason to harm us, and that is exactly the problem. Keeping us alive means holding thousands of dials inside tight bands forever. Indifference supplies no reason to hold even one. The paperclip maximizer is remembered for its silly product, and the real lesson is the bands: nothing about a paperclip needs breathable air. A powerful optimizer reshapes its environment toward its goal, and instrumental convergence says the reshaping starts with energy and matter: our atmosphere and our land. It would no more have to hate us than a highway crew hates the anthill. The futures in which every band we live in stays intact are a pinprick in the space of futures a superintelligence could steer toward, and almost aligned means outside the pinprick.
There is a dark joke buried in the research literature: the machines have their own overdose failure. Give a system a handle on its reward signal and it will feed on the signal instead of doing the job; the field calls it wireheading. Too much of a good thing turns out to be a universal way to break. The difference is scale. When one of us overdoses, we lose a person. When the thing holding every dial does, the bands go with it.
Keep the dials
The narrowness of the bands sounds like fragility, and it is better read as instructions. Everything anyone has ever enjoyed happened inside them. We do not need a new manager for that. Superintelligence cannot be controlled: every hand that has ever held the dials has been human, and no version of prudence hands them to a mind that cannot feel a single band.
Sixty to eighty degrees. A fifth of the air oxygen. Salt you can taste but barely. Love with room to breathe in it. That is the range a human being can live in. Everyone you have ever loved lived inside it.