What Is Human in the Loop (HITL)?
A human-in-the-loop design places a person at a defined point in an automated process, with the standing to approve, correct or reject what reaches them before it takes effect. The defining property is the checkpoint's position: it sits upstream of the consequence, not downstream reviewing one that has already happened.
Where the checkpoint sits, and what each placement buys
Three placements are common and they are not interchangeable. Approval before the effect: nothing proceeds until a person releases it. A withdrawal window: the action proceeds and can be recalled for a defined period. Sampling: a portion of the flow is reviewed and the rest proceeds untouched, which measures a process rather than gating it.
Each buys something different and each has a characteristic failure. A blocking approval buys prevention and costs latency; its failure is the reviewer who approves everything, because approving is the fast path through a queue. A withdrawal window buys throughput and loses the cases that turn out to be irreversible sooner than the window closes. Sampling buys visibility and gates nothing at all โ which is exactly what it is for, and exactly what it is mistaken for.
The phrase has a second established sense, and the two are worth keeping apart because a specification naming the wrong one describes a different system. Everything above is an operational control: a person standing in a live process, deciding one case at a time, present at the moment the case arrives. In machine learning the same phrase names a data-collection arrangement โ people supplying labels, corrections, or rankings of candidate outputs, which are then used to train. Reinforcement learning from human feedback is the familiar instance: rankings are collected from people, a reward model is fitted to them, and training optimises against that model. Nobody is present when the trained system afterwards runs. The judgement was gathered once and generalised, so it applies to every future case at once, which is the exact inverse of a checkpoint's defining property of applying to precisely one.
| Placement | What it actually gates |
|---|---|
| Before the effect | Nothing proceeds without an explicit release. |
| Inside a withdrawal window | The action proceeds and can be recalled for a defined period. |
| On a sample | A portion is reviewed; the rest is unaffected. Measures, does not gate. |
| On exception only | Cases meeting a stated condition are routed to a person; everything else proceeds. |
| After the fact | Audit. Changes future behaviour, never the action reviewed. |
Only the first two can stop anything, and only the first can stop everything. A design that calls itself human-in-the-loop while using the last row is describing an audit, which is a useful thing to have and a different thing to claim.
The reviewer has to be able to decide
A checkpoint functions only if the person at it has the information, the time and the standing to refuse. All three are routinely absent. A queue arriving faster than it can be read produces approvals rather than review. A summary that omits what the decision turns on produces a decision about the summary. And a reviewer whose refusals are treated as obstruction stops refusing, which removes the control while leaving the diagram intact.
The design question is therefore not whether a person is present but what that person is deciding, on what evidence, and what happens when they say no. Those three answers are the design. Everything else is routing.
Two records separate a working control from a diagram of one, and both have to be written at the moment of the decision because neither can be reconstructed afterwards. The first is the refusal. A checkpoint that has rejected nothing is indistinguishable, from outside, from a step that forwards everything, so the log of what was turned back is the only available evidence that the gate was ever load-bearing. The second is what the reviewer was shown. A decision taken on a summary is a decision about the summary, and an audit that finds an approval recorded without the material it was given cannot establish what was approved. Neither record is expensive; both are usually added after the first case where the answer to "who agreed to this" turned out to be nobody in particular.
How the Registry classifies an approval-gated task
Routing a refund decision to a reviewer before the payment is released is filed as a transaction in this registry's classification. The class covers purchases, bookings, payments and orders, and the presence of an approval step does not move a task out of the class the task belongs to.
The Registry's canonical brief for this entry is filed as:
Route every outbound refund decision to a human reviewer for approval before the payment is released.
Submitted for assessment it is
classified as Transaction, and its wording is hashed once โ to
3c7154ac4e7abcb3โฆ, the first sixteen of sixty-four hexadecimal
characters โ with the wording itself never stored. The hash is what the derivation
reads.
That class's own page is /tasks/transaction.
Classification is one of three inputs. The other two are the configuration submitted with the task, and the permanent chart derived from that configuration โ fixed by the model name, the training cutoff and the temperature alone, and never reading the task at all. The same ascendant, ruling planet and harmony therefore appear on every assessment a given configuration receives, whatever it was asked to do. The derivation is published in full at /method.
What this page does not claim about human in the loop
Whether a given process is obliged to keep a person in it is a question for whoever holds that obligation. This page describes where checkpoints are placed and what each placement can stop; it does not determine what any particular operator is required to do.
The Registry does not run this task, does not inspect any system's output for it, and validates no assessment it issues against what afterwards happens. What it does is compute โ from a published method, for one submitted task and one submitted configuration โ a verdict and a recommended execution window. It computes neither on this page.
Questions about human in the loop
- What is human in the loop?
- A human-in-the-loop design places a person at a defined point in an automated process with the authority to approve, correct or reject what reaches them before it takes effect. The checkpoint sits upstream of the consequence rather than reviewing it afterwards.
- What is the difference between human in the loop and human on the loop?
- On-the-loop generally describes supervision of a running process โ a person monitoring it, able to intervene โ while in-the-loop describes a person the process passes through. The terms are used loosely enough that a specification should state where the checkpoint sits rather than rely on the label.
- Does a human checkpoint slow the process down?
- A blocking approval does, by design: nothing proceeds until it is released, and that latency is the price of the prevention. A withdrawal window or an exception route trades some of that prevention back for throughput. There is no placement that gates everything and costs nothing.
- When should a decision require a person?
- Where the effect is irreversible, where it reaches someone outside the operator, or where a rule requires a person to make it. The first two are design judgements about blast radius. The third belongs to whoever holds the obligation and is not settled by a page like this one.
- What does human in the loop mean in machine learning?
- There the phrase names a training-time arrangement rather than a runtime gate: people supply labels, corrections or rankings of candidate outputs, and those judgements are used to train. Reinforcement learning from human feedback is the common instance. The difference that matters is when the person acts โ once, before deployment, with the result generalised across all later cases, rather than during a single live decision.
Related entries
Multi-agent system ยท Browser agent ยท Function calling
โ All entries ยท The AFR-1 method ยท Models in the registry
Order an assessment for transaction tasks
The Registry issues a permanent, numbered task risk assessment for one submitted task and one submitted configuration. EUR 1.90 Standard, EUR 4.90 Extended, EUR 14.90 Full Chart, which adds the permanent chart. Assessments from EUR 1.90; machine-readable at /pricing.json.