Lesson 5 · Independent validation
The validator loop: FAIL is the tuition
The validator is never the builder. Every round re-opened real evidence, named exact leaks with file:line, and the rule was always the same: one generic fix per pass, never a hardcoded id, then re-prove everything.
Six rounds, honestly
| Round | Verdict | What it bought |
|---|---|---|
| Gold set v1 | FAIL | 7 cases replaced, one receipt re-bound — same entity, never same theme |
| Gold set v2 | PASS 40/40 | 62/62 receipts verbatim, certified by a second independent validator |
| Pipeline v1 | FAIL | Wiki scaffold filter, word boundaries (dor/hate), PT demanda anchor, author "me" |
| Pipeline v2 | FAIL | Mythos/captions boundaries, question guards, negation stripping, já-era comparative, "already dead" |
| Pipeline v3 | FAIL | Evolving needs a not-dead anchor; trend needs a bounded market word |
| Pipeline v4 | PASS | Gold gate unblocked; full 2.537-package run allowed |
| Final A+B | FAIL | STRICT WTP v3, cross-package alias dedupe, subject-compatible conflicts |
The pattern that made it converge
Re-open, never trust
Every validator re-opened quotes at raw file:line — 196/196 byte-exact receipts while still failing the semantic bar. Integrity and semantics are different gates.
Fix the class, not the case
Each FAIL named a false-positive class (substring, false friend, idiom, role). The fix was always a generic rule — hardcoding an id would have been instant rejection.
Prove both directions
Every fix re-ran the full suite: the leak dies AND the genuine evidence survives. 10/10 + 10/10 + 1/1, byte-identical twice.
"Locators are honest; kind classification is not."Validator A, round 1 — the sentence that reframed the whole bar