Evals
Automatic checks that run every time an agent finishes a turn, so quality is measured on real work, not just in testing.
Turn 1
Turn 2
Turn 3
Turn 4
On every turn
Checks run each time the agent finishes a turn on real work, without slowing its response.
Turn on INV-2207Invoice paid
Rule
{{amount <= 5000}}Pass
JudgeClaude Haiku 5.5
Helpful?0.92
Rules or a model judge
Check exactly what can be checked, and have a model score what can't.
Quality94%
Policy99%
Workflow87%
Quality, policy and workflow
Track whether answers are useful, rules are followed and the right steps were taken.