Insights · Architecture

Why Every AI Agent Needs a Control Plane

Cloud infrastructure learned this lesson decades ago: separate the thing that does the work from the thing that governs the work. AI agents are re-learning it the hard way.

Modern infrastructure is built on a single, hard-won distinction: the control plane and the data plane. The data plane does the work — routing packets, serving requests, running containers. The control plane decides what the data plane is allowed to do — who may connect, which policies apply, how much capacity is granted, what gets logged. Kubernetes, service meshes, cloud networking and databases all share this shape. It is not a stylistic choice. It is the only architecture that lets you operate systems that are simultaneously fast, safe and observable at scale.

AI agents today are almost universally built without this separation. The agent is the data plane and the control plane at once. It decides what to do, and it decides whether it is allowed to do it, in the same breath, using the same model, guided by the same prompt. That collapse is the source of most production pain. An agent that governs itself is a process with no supervisor.

What a control plane is for

A control plane exists to answer questions the worker should never be trusted to answer about itself. For an AI agent, those questions are:

  • Identity: who is this agent, on whose behalf is it acting, and what authority has been delegated to it?
  • Permission: is this specific action, on this specific object, allowed under the policy that is active right now?
  • State: what is the authoritative status of the workflow, and is the transition being attempted legal from here?
  • Coordination: which other agents are touching this resource, and who has the right to act?
  • Accountability: what exactly happened, under which policy version, and who approved the exceptions?

When these live inside the agent, they are answered by inference — probabilistically, differently each time, invisibly. When they live in a control plane, they are answered by enforcement — deterministically, identically, on the record. The whole value of the control plane is that it takes the trust-critical decisions out of the non-deterministic component.

An agent should be able to propose anything and enforce nothing. The control plane proposes nothing and enforces everything.

The data plane can be creative. The control plane cannot.

This division of labour is what makes governed autonomy possible. You want the agent — the data plane — to be inventive, exploratory, even occasionally wrong. That is where the value of a large model lives. Creativity is only dangerous when it is also authoritative. The control plane removes the danger by removing the authority: the agent may generate any plan it likes, but every step of that plan has to clear the control plane before it touches the real world.

This is why "make the model more reliable" is the wrong goal. You do not need a model that never proposes a bad action. You need a system where a bad proposal cannot become a bad action. That is a control-plane property, not a model property, and no amount of fine-tuning delivers it.

What belongs in an agent control plane

A production-grade agent control plane has a recognisable set of components, each mapping to one of the questions above:

  • An identity and delegation service. Every human and every agent has a sovereign identity. Authority is granted explicitly and can be scoped, time-boxed and revoked. An agent never acts with more authority than has been delegated to it.
  • A policy engine — the constraint fabric. A single evaluation point through which every proposed action passes. It is fail-closed: if an action cannot be proven permitted, it is denied. Policy is versioned data, evaluated deterministically, not prose in a prompt.
  • A state authority. The control plane, not the transcript, owns the truth about where each workflow is. Illegal transitions are impossible; crashed runs can be resumed because the state is durable and external to the agent.
  • A coordination substrate. When many agents share a resource, the control plane arbitrates ownership, deliberation and consensus so work is neither duplicated nor lost.
  • A unified audit ledger. Every decision, its inputs, the policy version behind it and every human approval are hash-chained and replayable. Observability is not a bolt-on; it is where the control plane keeps its records.

A useful test

Ask of any agent action: "if the model had been adversarial, what would have stopped it?" If the honest answer is "the prompt" or "nothing," you have no control plane. If the answer is "the constraint fabric would have denied it and logged the attempt," you do.

Why the control plane must be shared

A subtle but critical point: the control plane cannot live inside each agent, even as a library. If every agent carries its own copy of the rules, then every agent can be convinced to ignore them, and there is no single place to update policy, no consistent view of state and no unified record. The control plane has to be a separate, authoritative service that agents call into and cannot bypass. This is exactly why cloud platforms centralise their control planes rather than embedding them in every workload. Enforcement only works when it is external to the thing being enforced.

This also future-proofs the system. Models change monthly; frameworks come and go; today's agent SDK will be legacy within a year. A shared control plane lets you swap the data plane freely — a new model, a new framework, a new vendor — while identity, policy, state and audit stay constant. The governance you built does not evaporate every time the AI world reinvents itself.

From scripts to systems

The teams treating agents as scripts — clever prompts calling tools — will keep hitting the same wall, because a script has no control plane. The teams treating agents as workloads running on a governed platform will pull ahead, because they have separated the creative part from the trustworthy part and can scale each independently. That separation is the essence of ECOS: agents propose, the constraint fabric disposes, and everything is on the record.

Every serious computing platform in history eventually grew a control plane, because you cannot operate powerful, autonomous processes safely without one. AI agents are powerful, autonomous processes. The only question is whether you build the control plane on purpose, up front — or improvise it in production after the first thing an ungoverned agent should never have done.

See the control plane in action

ECOS is the control plane for enterprise AI agents — identity, policy, state and audit in one governed layer.

Book a governed demo

Keep reading

Systems

Agent Coordination vs Agent Orchestration

Architecture

Building an AI Operating System