Skip to content

Deterministic assertions

Use exact checks wherever the evidence permits them, and reserve narrow semantic rubrics for the places where language interpretation is genuinely necessary.

Deterministic assertion packs are engineering-owned and optional. They are referenced from the config alongside workflows and rubrics:

test_suite:
workflows:
- generated/workflows/block_card_placeholder.workflow.yaml
rubrics:
- generated/rubrics/block_card_placeholder.acceptance.rubric.yaml

Because assertions are evaluated against saved evidence, you can change them and re-score an existing run without calling the agent again — see replaying evidence.