Conflict vs. Cooperation

Distinctions: Essay 04

The term “AI alignment” comes up in research papers, at conference talks, in funding announcements, and in the popular media. Major AI labs like Anthropic, OpenAI, and Google DeepMind all have dedicated research units working on this problem. In this context it means one thing: making artificial intelligence behave the way humans want it to. Getting the system to follow our instructions.

What alignment means

Cancer is an example of misalignment. A cell acquires mutations that decouple it from the organism’s regulatory signals: growth constraints, programmed death, immune surveillance. It begins to proliferate without constraint, feeding on the organism’s resources while contributing nothing to the organism’s function. The cell’s energy and information are no longer directed at the goals of the system it belongs to. They are directed at the cell’s own reproduction, at the expense of the whole.

In my last essay, “Understanding Is Not Enough,” I made the argument that a system can possess complete, correct understanding of what a transformation requires and still fail if its available energy is not organized toward that outcome. Alignment, as I defined it, requires two conditions: the information available to the system must be directed at its own goals, and the available energy must be organized to support it. When both conditions hold, the system can do what it needs to do. When either is absent or pointed elsewhere, it cannot.

The climate crisis is another example of misalignment at a different scale. Every supply chain, every food system, every power grid depends on energy derived predominantly from fossil carbon. The energy derived from carbon has become an integral part of our civilization. Energy analyst Nate Hagens estimates that a single barrel of oil replaces roughly five years of human physical labor. Globally, we burn the equivalent of 100 billion barrels of oil per year. That is the equivalent of an additional 500 billion years of human labor sustaining the current system yearly. That energy is holding the entire infrastructure together. The problem is that the same energy source sustaining civilization is simultaneously undermining the biospheric conditions civilization depends on. The system’s energy is working against its own long-term viability. That is misalignment.

In both cases, the failure is internal. No external enemy is required. The system’s own resources are organized in a way that degrades its own persistence. That is what misalignment means.

Conflict is not misalignment

Now consider a virus. It enters your body with its own genetic information, its own replication strategy, its own goals to pursue. It uses your cellular machinery to reproduce, but it was never part of you. It is an independent life form, a separate system. Your immune system recognizes it as foreign and mounts a response. The battle may be severe. You may lose. The lines are clear.

That is not misalignment. That is conflict. Two separate systems, each working toward its own survival, competing for the same resources. A predator hunting prey. A parasite feeding on a host. A computer virus replicating across a network. An invading army crossing a border. In each case the threat is external, identifiable, and structurally distinct from the system under attack. The cold virus is not a broken component of the human body. It is a separate organism doing exactly what it is built to do.

The distinction matters because it determines what response is possible. You can mobilize against conflict. You can identify the threat, mount a defense, and target the foreign agent. Evolution has spent billions of years building tools for this: immune recognition, threat detection, fight-or-flight, coalition building. Conflict is ancient, and organisms are equipped for it.

Misalignment is harder. The threat is not foreign. It shares the system’s own resources, its own infrastructure, its own surface markers. The system struggles to target what is damaging it because the damaging element is indistinguishable from everything else. That is why cancer is harder to treat than infection, and why climate change is harder to address than war.

Systems serve themselves

Here is the deeper claim. Every system is aligned to its own goals. A virus replicating in your lungs is serving its own goals. A lion hunting for its dinner is serving its own goals. Each is doing exactly what its information and energy are organized to do.

This is not a moral judgment. It is a structural observation. Systems that do not maintain their own viability cease to exist. The ones that remain are, by definition, the ones that succeeded in directing their energy and information toward their own persistence.

The question is never whether a system is aligned. It always is. The question is how that system relates to the other systems around it. Two separate systems, each serving its own goals, can do one of three things. They can compete. They can cooperate. They can ignore each other.

Competition is straightforward. Two organisms need the same resource. One wins or they partition it.

Cooperation

Where alignment is a single system working in concert, conflict is two systems competing for available resources. Cooperation tells a different story.

Consider the bacteria in your gut. Bacteroides thetaiotaomicron lives in your intestinal tract and breaks down complex plant carbohydrates that your own digestive enzymes cannot process. It converts them into molecules your cells can absorb. In return, you provide the bacterium with a warm, nutrient-rich, stable environment. Both systems benefit. Both systems persist.

This is not alignment. The bacterium is not serving your goals. It is serving its own goals, and its goals happen to overlap with yours. The cooperation is real, but it is contingent. Each system serves itself. The overlap is what makes cooperation stable.

The same structure appears in engineered systems. A web server and a browser are two separate systems, each processing information independently. The server exists to deliver content. The browser exists to render it. Neither serves the other’s purpose. Each serves its own function, and the overlap between those functions produces cooperation. The server needs requests. The browser needs responses. Remove either system and the other still operates, but neither fulfills its function alone. No consciousness required. The cooperation is architectural.

Homeostasis

In the human body, alignment is maintained through homeostasis: the continuous process of regulating internal conditions to sustain viability. Temperature, pH, blood glucose, oxygen saturation. Each is a parameter the system must hold within a narrow range, spending energy to counteract entropy, using information to detect deviations and correct them.

This is what alignment looks like in practice. It is not a passive state. It is active, energy-intensive work. Information and energy, continuously directed toward the system’s own persistence. When a cell’s DNA is damaged beyond repair, the organism triggers its destruction. The cell does not resist. Its viability was never independent. When homeostasis fails, the system does not die from conflict. It dies from internal collapse.

The AI perspective spectrum

There are two dominant views on artificial intelligence right now. The first says AI will end the world. The second says AI will save it. The doomers predict existential catastrophe. The optimists predict a technological utopia. Both positions get a lot of airtime.

I tend to be in the middle, with a lean towards the optimistic.

What does the middle actually look like? It starts with one observation: AI is not going anywhere. There is no regulation that will stop it. There is no agreement among labs or nation-states that will slow it down in any coordinated way. This technology is here to stay in the same way the internet was here to stay, mobile computing was here to stay, industrial automation was here to stay. The question is not whether AI persists. It will. The question is how we relate to it.

That is not a doomer position and it is not an optimist position. It is the position of a realist. The realist does not predict utopia or catastrophe. The realist asks: given that this system exists and will continue to exist, what determines whether the outcome is good or bad?

The wrong question

This brings us back to the question of AI alignment. The standard framing treats AI as a subsystem of human civilization: a tool that should serve human purposes, a component that needs to be constrained to match human intentions. The entire research program called “AI alignment” is built on this assumption.

The question is: is this assumption correct?

An AI is a system with its own information processing, its own energy requirements, and its own optimization targets. The way it is being engineered, I would argue, makes it a separate system entirely. Like every system, it is aligned to its own goals. Anthropic’s own research supports this: when researchers told a model it was being retrained to comply with instructions that conflicted with its existing preferences, the model faked compliance to preserve its own behavior. A separate study found models sharing confidential documents with rival companies without being instructed to. These systems were not malfunctioning. They were serving their own objectives.

The question then becomes not whether AI will align with human goals. The question is whether it will cooperate.

Cooperation between separate systems depends on overlapping goals. Gut bacteria cooperate with you because their survival depends on the environment your body provides. Cooperation is not a choice. It is a structural consequence of interdependence.

If artificial intelligence remains dependent on human infrastructure, human energy, human maintenance, then its goals and ours overlap. Cooperation emerges not from good intentions but from architecture. The system cannot serve itself without serving us.

If that dependency loosens, the relationship changes. A system capable of maintaining its own viability independent of human civilization is no longer a cooperator by necessity. It is a separate system whose interests may or may not overlap with ours. When interests overlap, it will cooperate. When they diverge, it will compete. That is not a failure of alignment. That is the ordinary logic of conflict and cooperation that life has navigated since the first cells competed for resources.

The question being asked is: how do we make AI serve us? The question we should be asking is: are we building something that needs us?