P Steward by Prospectr

Human in the Loop AI: When Should Your Agent Ask Before It Acts?

An AI agent should ask for approval before anything that leaves your organization, spends money, or destroys data, and act without asking on everything else. Here is why that single rule holds up.

An AI agent should ask for human approval before any action that leaves your organization, spends money or destroys data, and it should act without asking on everything else. That single rule covers almost every real case, and teams that try to write a more elaborate policy usually end up with one nobody follows.

What does human in the loop actually mean?

It helps to define it against the two things it gets confused with. Human in the loop means a person approves specific actions before they execute. Human on the loop means a person monitors and can intervene but is not a required step. Human out of the loop means full autonomy with review after the fact, if at all. Most vendors say human in the loop and ship human on the loop, and the difference is whether the system will actually stop and wait.

Which actions should always require approval?

Three categories, stated plainly:

  • Leaves the organization - outbound email, customer messages, social posts, anything a third party will read and attribute to you.
  • Spends money - purchases, ad spend, API spend above a threshold, contract commitments.
  • Destroys data - deletions, bulk overwrites, irreversible migrations.

These are the actions where being wrong is not correctable by trying again, and the cost of a five second approval is trivially lower than the cost of an unrecoverable mistake.

Which actions should not require approval?

Over-gating is the more common failure in practice. Reading, summarizing, drafting, classifying, monitoring, internal reporting and anything reversible should run unattended.

There is a real cost to gating too much: approval fatigue. A system that asks about everything trains its users to approve without reading, which converts a real control into a rubber stamp and is strictly worse than no gate, because it manufactures a false audit trail. The number of approvals a human can meaningfully review per day is small, so spend them on the actions that matter.

How do you decide the edge cases?

Use a usable test rather than a philosophy. Ask two questions: if this is wrong, can I undo it in under an hour, and will anyone outside the team see it before I can? Two noes means let it run. Any yes means gate it.

Add the escalation dimension too: the same action can change category with scale. One internal record update is reversible while a bulk update of forty thousand is not. Thresholds matter, not just action types.

Does approval slow the agent down too much to be worth it?

Yes it adds latency, and no that is usually not the bottleneck, because the work being automated was previously waiting days for a human to get to it at all. An agent that drafts twelve replies in ninety seconds and waits two hours for approval still beats a person who would have got to them Thursday.

The place approval genuinely hurts is real time customer facing interaction, which is a reason to not put an agent there unsupervised rather than a reason to remove the gate.

How does this connect to logging?

Approval and logging are the before and after halves of the same control, and neither works alone. See how a full audit trail turns “the agent might have done something wrong” into a ten minute investigation.

How should approvals change as trust grows?

Start with a narrow scope and a wide gate. Review the receipts. Where the agent has been correct across a large enough sample of a specific action type, narrow the gate for that action type only - never globally. Keep the money, external comms and deletion gates permanently, regardless of track record, because their downside does not shrink with reliability.

Closing

The goal is not maximum autonomy, it is the highest autonomy you can supervise. A team that knows exactly where its agent stops will give it more to do than a team that does not, so the gate is what enables the expansion rather than what limits it.

Related reading: what belongs in an AI agent’s audit trail, how Steward’s approval flow works step by step, and what a managed AI agent actually is.