Skip to content

How To Reconcile Divergent Audits

Two audits ran on the same wave (or the same packet decision) and returned different verdicts. How do you reconcile?

Recipe

  1. Verify both audits are real. Check that each audit was produced by an admitted independent loop, recorded under typed contract.
  2. Read the findings, not just the verdicts. A PASS audit may have caveats; a NEEDS_REVISION audit may name specific blockers.
  3. Stricter verdict wins by default. If one audit says NEEDS_REVISION and another says PASS, the NEEDS_REVISION verdict's findings are the active gate. The PASS audit cannot soften the blocker.
  4. The findings drive the resolution. Address the named blockers; do not just re-audit hoping for PASS.
  5. Record an explicit reconciliation artifact. Author audit-reconciliation-<topic-or-wave-id>.md capturing both audits, the findings list, and the chosen resolution.
  6. If reconciliation is not a code fix (e.g., the PASS audit was correct and the NEEDS_REVISION audit was based on a misread), record the rationale and the audit's correction pathway.
  7. Re-audit if needed. After resolution, re-run independent audit; record the new verdict.

Why Stricter Wins By Default

The four-closure framework requires all four dimensions to be explicit. A NEEDS_REVISION finding identifies a specific gap. A PASS audit that does not address that gap is silent on it, not contradicting it.

The methodology's structural rule: unresolved blocking findings fail closed. A PASS cannot override a blocking finding by simple disagreement; the finding must be addressed (resolved, declared non-blocking, or demonstrated invalid by typed evidence).

Reader Scenario: A Real Reconciliation

Wave-1 of the previous public docs remediation topic was audited by two independent sessions:

  • Audit A: PASS
  • Audit B: NEEDS_REVISION (with specific design-only-language finding)

The reconciliation:

StepAction
Both audits realConfirmed
Findings examinedAudit B's blocker was about boundary wording in topic-level files
Stricter winsAudit B's NEEDS_REVISION held
ResolutionUpdate boundary wording; preflight rescoped to admit later waves
Reconciliation artifactexternal-audit-round-N-reconciliation.md
Re-auditImplicit in subsequent wave admission audits

Audit A's PASS was accepted for design-package completeness; it did not override Audit B's boundary-wording blocker. The resolution addressed Audit B's specific finding.

Reader Scenario: Two PASS Verdicts With Different Caveats

Audit A: PASS, with non-blocking note "consider adding example" Audit B: PASS, with non-blocking note "consider tightening forbidden-shortcuts list"

These are not divergent in verdict; they are convergent with non-overlapping non-blocking notes.

Recipe:

  1. Both PASS verdicts are admitted.
  2. Non-blocking notes are recorded as future-improvement candidates.
  3. No reconciliation artifact required (verdicts converge).
  4. Future wave may pick up the non-blocking notes as scope.

Reader Scenario: A Disputed Verdict

Audit A: PASS Audit B: FAIL with finding "the work introduced silent_owner_cut_reopen"

The reconciliation:

StepAction
Verify Audit B's findingInspect the work; check whether the owner cut was reopened
If finding holdsAudit B's FAIL is the active gate; the wave's owner-cut reopen must be resolved or explicitly admitted
If finding does not holdAudit B's evidence is corrected; reconciliation artifact records why; Audit A's PASS holds

Either way, the resolution is typed and recorded, not "we took the verdict we liked."

What To Watch For

SymptomMeaning
Two audits same loopReject both; auditor must be independent
Looser audit picked because fasterSoft pass; reject
Reconciliation skippedMethodology rule violation; demand reconciliation artifact
Re-audit until PASSSoft pass; the findings still need addressing

Source Basis

Nimi AI open world platform documentation.