@ai-manifests/adj-validate
v0.3.0
Published
Validate ADJ journal entries and audit deliberation records
Downloads
121
Maintainers
Readme
adj-validate
Validate ADJ journal entries, audit deliberation records, and verify calibration scoring.
Install
npm install -g @ai-manifests/adj-validateUsage
Validate journal entries
adj-validate ./entry.json
adj-validate ./opened.json ./closed.json ./outcome.jsonValidate a deliberation record
Pass a directory of entry files to check sequencing, completeness, and consistency:
adj-validate --deliberation ./deliberation/Checks:
- First entry is
deliberation_opened, last (before outcome) isdeliberation_closed - Timestamp ordering across entries
- Participant consistency (proposal agents match declared participants)
- Hash chain integrity (if present)
- Outcome timing (
observed_atafterdeliberation_closed) - Tally arithmetic in
deliberation_closed(approve + reject + abstain = total, fractions match) - Termination consistency (converged requires approval >= threshold)
Audit calibration scoring
Verify Brier score computation for an agent across deliberations:
adj-validate --calibration ./journal/ --agent did:adp:test-runner-v2 --domain code.correctnessExtracts (confidence, outcome) pairs, computes the Brier score, and reports the calibration value.
Semantic Checks
| Check | Type | |-------|------| | Tally arithmetic (weights sum, fractions match) | Error | | Termination vs tally consistency | Error | | Falsification evidence requires target_agent_id | Error | | Outcome before deliberation_closed | Error | | Entry sequencing (proposals before rounds, correct ordering) | Warning | | Participant not in declared list | Warning | | Partial hash chain | Warning | | Ground truth with low reporter confidence | Warning |
Programmatic Use
import { validateEntry, validateDeliberation, computeCalibration, extractScoringPairs } from '@ai-manifests/adj-validate';
const result = validateEntry(entry);
const dlbResult = validateDeliberation(entries);
const cal = computeCalibration(pairs);Status
v0.1 — Validates against ADJ spec v0.
License
Apache-2.0 — see LICENSE for the full license text and NOTICE for attribution.
