@gbesse/jev-conformance
v0.1.0
Published
Provider-neutral conformance and quality benchmarks for Jev-compatible decision engines.
Maintainers
Readme
@gbesse/jev-conformance
Reproducible compatibility and quality reports for Jev-compatible decision engines. The same cases can be replayed against hosted, gateway, or local providers, then compared without conflating protocol compatibility with decision quality.
jev-conformance report cases.json observations.jsonl > report.jsonReports include protocol validity, accuracy when labels exist, boolean Brier score, repeatability, latency percentiles, and recorded cost. The package does not execute arbitrary provider code: capture observations in your own isolated runner and use this package for deterministic analysis.
import { createReport } from "@gbesse/jev-conformance";
const report = createReport(cases, observations);Never place secrets in cases or observations. Prefer redacted fixtures and stable case identifiers.
