dsh-rerun-grader-file
v0.1.2
Published
Grader provider asserting the shape and content of files an attempt left behind
Maintainers
Readme
dsh-rerun-grader-file
Grader provider asserting what an attempt left on disk. It fills the gap between
command and invariant: a task whose success is "this file now says X" has no
test suite to run and no discipline rule to check.
Every check reads the stored workspace diff rather than the live workspace, so this grader IS rescorable — a check added later applies to runs already in the store.
graders:
- kind: file
path: sum.mjs
adds: ['return a + b']
rejects: ['TODO']
- kind: file
path: test.mjs
unchanged: trueModel Experience
None. This package never contributes to a model request: it runs in the orchestrator process, and the model calls it cares about happen inside a separate attempt subprocess running a different build of DSH entirely.
KV Cache effect
None; it neither assembles nor sends a provider request.
Known Limitations and Deferred Work
- It sees added lines, not final content. A file whose final state is right because the agent added and then removed something is judged on what the diff shows.
- A file the attempt never touched is absent from the diff, so
changedfails for it — which is the answer you want, butunchangedcannot distinguish "left alone" from "never existed".
