AI Vocabulary

Verification pass: why is it better to check one thing at a time?

A verification pass is an automated control looking for one thing only: consistency of terminology, accuracy of internal cross-references, articulation of clauses with one another. Several successive passes, each on a single object, catch what a general review systematically misses.

Why a general review fails

Because attention does not divide. A reviewer checking terminology, cross-references and the coherence of caps at the same time does all three badly, not through negligence but through a well-documented property of human attention.

Yet those are precisely the costliest defects of a long document. A definition amended at clause 1 that shifts the meaning of 17 occurrences elsewhere is invisible: each passage, read on its own, is correct.

What a pass does

It traverses the whole document looking for one thing. A terminology pass lists every defined term and checks its use everywhere. A cross-reference pass opens each internal reference and confirms it designates what it purports to.

These are tasks at which a machine is structurally superior: repetitive, exhaustive, indifferent to fatigue. Checking 40 cross-references is work nobody does well at 11 p.m. on version 11.

The passes that count on a legal instrument

Four are worth requesting by name from a provider, because they cover the most frequent defects of long documents.

Terminology: is each defined term used in accordance with its definition, everywhere it appears? Amending a definition mid-negotiation is the leading cause of inconsistency.

Internal cross-references: does each reference to a clause designate the one it claims to, in the document's current state? Inserting a paragraph shifts the numbering and leaves references pointing elsewhere.

Coherence of mechanisms that answer one another: caps against caps, periods against periods, conditions precedent against the timetable.

And cited sources: does each reference exist, and does it say what it is made to say?

The side effect that matters

Each pass leaves a record of what it checked and corrected. At the end, one has a statement of the controls performed.

That changes the reviewer's position: knowing terminology has been checked exhaustively, they can devote attention to what no pass addresses — the appropriateness of the choices in light of the matter, the only point where their judgement is irreplaceable.

What it does not solve

A pass verifies coherence, not relevance. A perfectly coherent document may be unsuited to the matter: the definitions answer one another, the cross-references are exact, and the warranty clause does not match what the client negotiated.

Passes therefore address only half the problem. The other half is context: what the system knows of the matter, not how it produces text.

They dispense with no substantive review, and a firm treating them as validation would be mistaken about what they establish.

Why it matters to a lawyer

Because this is where the machine delivers a net and verifiable gain, without anyone giving up any part of their judgement.

The question to put to a provider is therefore concrete: which passes are run, on what objects, and can I see what they checked? A system producing a document with no distinct pass produces text, not verified work.