When a team builds an AI feature, the first product decision is not the model. It is where to put the human. Does the AI assist a person, or does it act on its own? Is it a copilot or an autopilot?

The two names sound like points on a spectrum of autonomy, but they are actually two different products with different users, different failure modes, and different trust requirements. Confusing them is the source of a remarkable amount of bad AI UX.

Copilot and autopilot are different products

A copilot helps a person do a task. The person is in charge, and the AI suggests, drafts, and accelerates. A coding assistant is a copilot: it writes a suggestion, the developer accepts or rejects it, and the developer is responsible for the result.

An autopilot does the task on behalf of a person. The system is in charge, and the human supervises. An aircraft autopilot flies the plane, and the pilot monitors it and takes over when needed.

The difference is not how much AI is involved. It is who is accountable when something goes wrong. That single question determines almost everything about the product: the interface, the error handling, the trust model, and the cost of a mistake.

The spectrum is a trap

The tempting mental model is a dial: turn autonomy up for power, down for safety. It suggests a product can smoothly slide from "assistant" to "agent." In practice, the dial is a cliff. At some point, the human stops being able to meaningfully supervise, and the product silently becomes an autopilot without any of an autopilot's safeguards.

This is where products go wrong. They position themselves as copilots, so the user feels responsible, but they act like autopilots, making consequential decisions on their own. Or the reverse: they promise autonomy but hand back too many decisions, so the user does all the work and the AI is just noise.

What a copilot owes its user

A copilot has one job: make the human faster without taking away their ability to judge. That has a specific set of obligations.

The human needs enough context to decide. A suggestion with no explanation asks the user to approve something they cannot evaluate. The human needs the decision to be cheap to override. Accepting or rejecting should be effortless. And the human needs the responsibility to stay clear. A copilot should never quietly escalate into an autopilot.

When these obligations are met, the user gets faster and stays accountable. When they are not, the user either blindly approves everything, or abandons the tool because reviewing it is more work than doing the task.

What an autopilot owes its user

An autopilot has a harder job, because it is the one acting. Its obligations are about oversight and containment.

The system needs clear guardrails: what it is allowed to do on its own, and where it must stop and ask. It needs to surface its own actions, so the supervising human can see what happened and why. And it needs a reliable way to take over, because an autopilot you cannot switch off is a liability.

Autonomy only works when the human can supervise effectively, and effective supervision requires the system to be legible. An autopilot that acts invisibly is not an autopilot. It is a risk.

The middle zone

Most real products live in the middle, where the AI does part of the work and the human does part. The middle is legitimate, but it is also where the accountability gets blurry, and blurry accountability is where products fail.

The fix is not to pick an abstract autonomy level. It is to be specific about which decisions the AI makes and which the human makes, and to make the boundary visible in the interface. A product that is clear about the split, even if the split is complex, is easier to trust than one that leaves it ambiguous.

The underlying question, whether the system is honest about what it might get wrong, is the subject of designing for an interface that gets things wrong.

Choose by consequence, not coolness

The decision of where to put the human should be driven by one thing: the cost of a mistake.

When a mistake is cheap and reversible, autonomy is fine. Let the AI sort the inbox or draft the summary. When a mistake is expensive or irreversible, keep the human in the loop. Sending money, publishing content, making medical or legal decisions, anything that cannot be easily undone, is where the human stays.

Teams often make this decision the other way around, drawn toward autonomy because it feels more advanced. But autonomy is not a reward for good technology. It is a responsibility, and the technology should only be given as much of it as the cost of error justifies.

The takeaway

Copilot and autopilot are not two settings on one product. They are two products with different contracts. The decision between them is not a technical dial; it is a product decision about accountability, driven by the cost of being wrong. Ask first what happens when the system fails, and who answers for it. The answer will tell you where the human goes.