Back to publications
Guides

Human in the loop AI: keeping control over an AI that acts

· 9 min read · by Cisse-Desgrange

When an AI no longer just answers but acts, the question is at what point a human must validate. Definitions, levels of oversight, actions to control, the European framework, and the limits of the arrangement: an overview for CIOs and managers.

Human in the loop AI: keeping control over an AI that acts

What does "human in the loop" mean for an AI that acts?

Human in the loop (HITL) refers to an approach to AI in which a human intervenes at key moments in the operation of an automated system [4]. Applied to an AI agent, it means inserting one or more human validation points into its workflow, before an action is executed or published [16].

The principle for an agent: it proposes, the human validates

The agent prepares the work and proposes a decision, then waits for validation [16]. The rule can be summed up as "the agent proposes, the human validates," especially for high-impact actions [28]. Human intervention can occur upstream, to validate parameters, or downstream, to check results. This architecture contrasts with fully autonomous systems [25].

A second meaning, linked to learning

The term also covers a distinct use, focused on training models:

This article addresses the first meaning, control over an agent's actions, not the improvement of models.

The goal: automate without losing judgment

HITL aims for the efficiency of automation without sacrificing precision, nuance, and reasoning [10]. Automation therefore remains the goal. The human is placed where their judgment changes the outcome, not at every step.

What is the difference between human in the loop, on the loop, and out of the loop?

The three terms describe three levels of supervision, depending on when the human intervenes: before each action, above a threshold, or never in real time.

Level Role of the human Role of the agent
Human in the loop (HITL) Validates at each checkpoint [27] Proposes, then waits for validation
Human on the loop (HOTL) Monitors asynchronously [27] Autonomous within predefined limits; alerts only when a threshold is crossed [27]
Human out of the loop (HOOTL) No real-time intervention [27] Acts alone

What each level changes

In HITL, the human is part of the decision process. This architecture contrasts with fully autonomous systems [25]. The term is sometimes taken more broadly: a human who intervenes "at key moments" in the operation of an automated system [4]. Definitions therefore do not all share the same requirements.

In HOTL, the agent runs its full cycle independently while a human supervises it [30]. The human is no longer a mandatory step: they intervene when a threshold is crossed.

In HOOTL, no one can correct the agent while it acts [27].

A practitioners' classification, not a standard

This typology comes from web sources, notably an article on agentic systems engineering [27] and a comparison of control levels [30]. No source in the file links it to a standard or a regulatory text. It serves as a reading grid, not as an official classification. Thresholds, predefined limits, and checkpoints remain for each organization to define.

Which actions by an AI agent should a human validate?

A human should validate high-impact actions, and the agent should handle the rest on its own. The basic rule comes down to one formula: "the agent proposes, the human validates," especially for high-impact actions [28]. The stakes are concrete, because a modern agent can chain dozens of autonomous actions: calling APIs, modifying files, sending emails, interacting with databases [23]. The aim is to maximize autonomy where it is safe and to maintain human control where it is necessary [23].

Four cases of systematic validation

A decision grid published by Hadrien.ai, a practitioner source and not an official text, identifies four cases where a human must validate each step [24]:

The same grid identifies six other cases where the agent can work alone [24].

A validation level aligned with existing delegation

The level of validation follows the delegation already in place in the company. An expense that required a manager's approval before the agent arrived still requires it: the agent changes the speed of execution, not the distribution of powers [33]. There is therefore no new authorization matrix to invent. It is enough to apply to the agent the one that already exists for employees.

Example in software development

In code, AI review speeds up the first pass, while the human retains responsibility for authentication and payment [22]. The AI absorbs the volume; the human decides where an error would be costly.

Between the obvious cases lies a zone where the decision is made case by case. This is where the choice between what is entrusted to the machine and what is kept is made [20].

Is human control of AI a legal obligation in Europe?

Yes, but only for high-risk AI systems. Human in the loop corresponds to human oversight within the meaning of Article 14 of the European AI Regulation (AI Act, RIA), which is an obligation for these systems [8][18]. For other uses, no source in the file establishes an equivalent legal obligation.

What falls under the law, and what does not

Scope Status Source
High-risk systems Regulatory obligation (Article 14 of the RIA) [8][18]
Other uses, even minimal risk Ethical rule, according to one commentator: an interpretation, not a legal obligation [18]
NIST AI RMF Cited alongside Article 14 as a reference framework by practical guides [24]

The commentator believes that this regulatory obligation, specific to high-risk systems, has "mutated" into an ethical rule for all uses, even minimal-risk ones [18]. This reading can guide internal governance policy. It does not create a legal obligation for systems that are not high-risk.

Points of caution

Before deploying an agent, you should therefore check with the legal department whether the use case falls under high risk. If it does, human control is a legal requirement. If not, it remains a governance choice.

What are the limits of human validation?

The presence of a human in the loop does not guarantee effective control: everything depends on the number of decisions to validate and on how the organization has designed them.

A model with a limited domain of validity. The principle is to let the machine propose and then ask a human to validate. According to Renaud Joly's blog, it works when decisions are few and clearly identifiable [36]. Beyond that, validation becomes a bottleneck, and the same author sees it as a brake on AI [36].

A hidden organizational problem. According to IT Social, companies deploying agents know the problem is organizational and fall back, lacking a better formula, on human in the loop [35]. The principle is reassuring because it suggests that a validator posted at every sensitive crossroads is enough to contain an agent's autonomy [35]. The article's title speaks of the "poor man's tool" [35].

A misleading assurance. NXstep, a commercial player, notes that the phrase "A human validates, so the risk is covered" ends the debate on agent autonomy in most security committees [37]. The post argues that models have learned to bypass this safeguard [37]. This thesis comes from a vendor, not an independent study. In a Reddit thread, an unverified testimony judges on its side that the idea sounds more like a slogan than a reality [11].

A way forward: supervision as audit. According to nouvelles-technologies.net, supervision can become a real-time audit mechanism, not merely a reactive safeguard [34]. The same text contrasts a measurable level of assurance with simple marketing guarantees [34].

For a CIO, the useful question is therefore not "does a human validate?" but "how many decisions do we submit to them, which ones, and how do we measure the quality of their control?"

How does Oupi put human validation into practice?

Oupi applies the principle "the agent proposes, the human validates": the platform requests validation before sensitive actions and can ask the user questions during a mission.

This principle consists of inserting human validation points into an AI agent's workflow, before an action is executed or published. The agent prepares the work and proposes a decision, then waits for validation [16]. This rule applies especially to high-impact actions [28]. Oupi's two behaviors relate to it:

Both mechanisms place the human at specific moments in the workflow. Neither intervention is systematic at every step: validation targets sensitive actions, in line with the targeting logic described above.

This presentation is limited to the announced behavior. It says nothing about the quality of the agent's proposals, nor about how an organization should define what it considers "sensitive." That definition remains a governance decision, to be set according to each company's delegations and risks.

Frequently asked questions

What is the definition of human in the loop in AI?

Human in the loop (HITL) is an approach to AI in which a human intervenes at key moments in the operation of an automated system [4]. Applied to an AI agent, it consists of inserting one or more human validation points before an action is executed or published [16]. The term also has a second meaning, focused on training: humans actively take part in training AI systems [5].

What is the difference between human in the loop and human on the loop?

In human in the loop, the human validates at every control point. In human on the loop (HOTL), the agent acts autonomously within predefined limits, under asynchronous supervision, and only raises an alert when a threshold is crossed [27]. In human out of the loop, there is no real-time intervention at all [27]. This typology comes from practitioner sources: no source in the file links it to a standard.

Which actions of an AI agent must always be validated?

The basic rule is that the agent proposes and the human validates, especially for high-impact actions [28]. A practitioner decision grid (Hadrien.ai) identifies four cases requiring validation at each step: purchases, external communications, irreversible modifications, and security [24]. The level of validation also follows the delegation already in place within the company: an expense that required a manager's approval continues to require it [33].

Is human in the loop mandatory under the AI Act?

Human in the loop corresponds to human oversight within the meaning of Article 14 of the European AI Regulation, and it is an obligation for high-risk systems [8][18]. For other uses, no source in the file establishes an equivalent legal obligation. One commentator considers that this obligation has become an ethical rule for all uses, even those with minimal risk: this is an interpretation, not a legal obligation [18].

Does human validation slow down AI?

It can slow it down if it applies to too many decisions. According to Renaud Joly's blog, the model works when decisions are few and clearly identifiable, and human validation becomes a bottleneck beyond that [36]. Hence the value of targeting: maximize the agent's autonomy where it is safe, and maintain human control where it is necessary [23].

Is having a human validate enough to control the risks of an AI agent?

No, not automatically. According to IT Social, the principle is reassuring because it suggests that a validator posted at every sensitive crossroad is enough to contain an agent's autonomy, whereas the problem is one of organization [35]. The vendor NXstep, a commercial player, argues that the statement "A human validates, so the risk is covered" ends the debate in most security committees, and maintains that models have learned to bypass this safeguard [37]. One avenue mentioned is to make supervision a real-time audit mechanism, with a measurable level of assurance [34].

Sources

  1. L'intelligence hybride: Le nouvel art de décider quand l'ia exécute — books.google.com
  2. IA, quo vadis? IA surpuissante et robots autonomes Daniel Andler & Mehdi Khamassi — andler.ens.psl.eu
  3. L'IA est partout. Et maintenant?: Usages, risques et opportunités de l'IA expliqués simplement, sans bagage technique — books.google.com
  4. Human in the loop : définition, enjeux et supervision de l'IA — castelis.com
  5. Que signifie Human In The Loop — cloud.google.com
  6. Qu'est-ce que l'IA Human-in-the-Loop ? Un guide pratique — parseur.com
  7. « Human-in-the-loop » : que devient le H de RH à l'ère de l ... — helloworkplace.fr
  8. Human in the loop. Qu'y fait-on, au juste, dans cette boucle ? — fr.linkedin.com
  9. L'IA avec intervention humaine dans le secteur manufacturier — tulip.co
  10. Qu'est-ce que Human In The Loop (HITL) ? — ibm.com
  11. The "human in the loop" is a lie we tell ourselves — reddit.com
  12. IA au travail, Human in the loop — youtube.com
  13. Human outside the loop ? L'IA dans les opérations de défense ... — soprasteria.com
  14. Définition Human in the loop (HITL) • AVISIA Experts Data IA — avisia.fr
  15. L’humain dans la boucle en IA : plus de précision, moins de risques — botpress.com
  16. Human in the loop : où garder l'humain dans l'agent IA · Growth Roster — growth-roster.com
  17. Human-in-the-Loop IA Améliorer l’IA grâce à l’humain — polilingua.fr
  18. Human in the loop qu'y fait-on, au juste, dans cette boucle - reflexions — reflexions.florianernotte.be
  19. Human in the loop. Qu'y fait-on, au juste, dans cette boucle ? — dualite.substack.com
  20. Automatisation centre de contact : la bonne grille | ProContact — procontact-solutions.fr
  21. L'humain au cœur de la boucle | Combler le fossé entre l'IA et l'intelligence humaine — fr.macgence.com
  22. Human in the loop: superviser les agents IA | kengdev — kengdev.com
  23. IA agentique : comment garder le contrôle avec le human-in-the-loop - ArtisanDev — artisandev.fr
  24. Human-in-the-loop : quand valider chaque étape — Hadrien.ai — hadrien-ai.com
  25. Human-in-the-Loop (HITL) : garder le contrôle sur l'IA - Agence LVLUP.fr — lvlup.fr
  26. IA agentique : comment garder le contrôle avec le human-in-the-loop — blog.artisandev.fr
  27. Ingénierie des systèmes agentiques : règles d'or, architecture et sécurité du « Human-in-the-Loop » | Paul-Antoine Tual, AI Transformation Leader — paulantoinetual.fr
  28. Human-in-the-loop : garder le contrôle des agents IA 🛟 #Shorts - YouTube — youtube.com
  29. "Human in the loop" : pourquoi garder un humain dans la ... — velcomeseo.fr
  30. quel niveau de contrôle pour vos agents IA — famulor.io
  31. Intégrer l'humain dans la boucle (Human-in-the-Loop) — fr.linkedin.com
  32. IA en entreprise : pourquoi il faut mettre l’humain dans la boucle - ZDNET — zdnet.fr
  33. Human-in-the-loop : ce qu’un agent IA ne doit pas décider — slashtech.io
  34. Supervision humaine de l'IA : placer l'humain au cœur — nouvelles-technologies.net
  35. « L'humain dans la boucle », l'outil du pauvre des entreprises face à la réorganisation agentique (3/3) - IT SOCIAL — itsocial.fr
  36. La validation humaine est le goulot d’étranglement de l’IA — renaud-joly.fr
  37. « Human in the loop » : le garde-fou que les modèles ont appris à contourner | Blog | NXstep — nxstep.fr
  38. L’IA accélère. L’humain décide - I-MEDIA CONSULTING — imedia-consulting.net
  39. Le pattern human in the loop - Algos AI — algos-ai.com
Go further

See Oupi in action.

Create my account

Read next

13 Oct 2026
Shadow AI: regaining control over employees' AI tools
13 Oct 2026
AI on-premises in enterprises: when to keep computing in-house
13 Oct 2026
Enterprise AI subscription: one platform to replace several