AB Governance Craft Kit

Measurement-validity discipline for AI governance

The missing discipline in responsible AI discourse — brought to the practice-operating scale.

The claim, in three parts

The AI governance conversation talks a lot about principles (fairness, transparency, accountability, safety), controls (documentation, oversight, human-in-the-loop / AI-in-the-loop (HITL/AITL — see AB audit for the signal-informed proxy formulation of the load-carrier axis)), and risk categories. What's largely missing: measurement-validity discipline. Do the controls measure what they claim to? Is what's being audited well-defined? Does the evidence support the conclusion drawn?

Kane's 4-inference validity framework — mature in educational / psychological testing since the 1990s — is basically absent from responsible AI frameworks (NIST AI RMF, EU AI Act, ISO/IEC 42001). AB brings that tradition to AI-native operations at a scope existing frameworks don't traditionally address: solo-practitioner and boutique consulting scale.

The proof-of-concept: the AB 90-day audit — and the record of how it audited itself in real-time.

▶ 23 discipline moves across 5 phases · the audit's own execution
Phase A
Definitional
9 moves
Phase B
Corpus & Instrumentation
5 moves
Phase C
Data Refresh
3 moves
Phase D
Quality Standard
3 moves
Phase E
Dissemination
3 moves

Not a checklist. A record of the discipline moves that surfaced during one audit's execution — visible, dated, available for peer review.

▶ Kane 4-inference mapping · validity theory in action
Link 1
Scoring
Did we measure it right? → Phase A
Link 2
Generalization
Real, or just noise? → Phase B
Link 3
Extrapolation
Reflects what matters? → Phase C
Link 4
Implication
Worth acting on? → Phases D + E

The audit did to itself what it audits others for. That IS the demonstration.

▶ Read deeper
Full craft log
AB Governance Craft Log
23 discipline moves catalogued with trigger · discipline · resolution · teaching. 7 emergent principles. Deep-read for peer review.
Source audit
AB 90-day audit §9
Canonical record: the audit itself, with the Section 9 methodology narrative as source of truth for this Craft Log.
Related evidence
Pinned artifacts
AB Governance Maturity Scorecard · Decision Scorecards · Task Allocation View · Dialogue Maturity Curve · Infrastructure & Architecture.