The Failure of Drift: Surveillance, Ranking, and the Slow Corruption of Purpose

The final family of failures is the slowest and, for that reason, perhaps the most dangerous, because slow failures evade the vigilance that sudden ones provoke. It is the gradual drift of Providence away from its founding purpose, through a thousand small and individually reasonable decisions, into a surveillance system, a ranking system, a moral hierarchy with the power to exclude — not through any single act of betrayal, but through the accumulated erosion that has corrupted nearly every institution that began with good intentions.

We have described this drift in the governance chapter as the general condition of institutions: incentives bend, accountability atrophies, memory fades, urgency overwhelms principle. Providence is not exempt, and its particular materials make its potential drift especially grave. A system holding the physiological records of millions, mediating their access to opportunity and resource, could become — through drift alone, with no villain required — the most refined instrument of social control ever constructed: a moral-ranking system that scores human worth, a surveillance architecture that reads the body, an engine of exclusion that decides who belongs. That it would arrive at this through gradual, well-meaning steps rather than through conquest does not make it less terrible. It makes it more likely.

So here is what we are already doing about it, and against slow drift the work must be built to act without us. We are building the defenses to fire automatically, without depending on the continued vigilance of people who may themselves have drifted: the sunset provisions that force renegotiation on a fixed schedule, the dissolution triggers that activate without a vote, and above all the architectural commitments — sovereign data that never leaves the participant's device, open code anyone can audit — that make certain betrayals technically impossible rather than merely forbidden. We are designing the whole system as if our successors will not share our intentions, because over a long enough horizon they will not, and a safeguard that depends on the goodwill of whoever holds power next is no safeguard at all. We are honest that no design fully defeats time. But we have studied the drift that destroyed those who came before us, we are building every automatic safeguard we know how to build against it, and we are writing this chapter into the foundation so that those who come after cannot say they were not warned of exactly how the thing they inherited might curdle in their hands — and so that they hold, in their hands, the automatic means to stop it.