Web browser

Check: docs-grounded answer accuracy

Jev judge eval (1 boolean + 1 score) over a fixed state : runnable via experimental_evaluate.

Triage: crash report routing + reproducibility

Jev judge eval (1 boolean + 1 choice) over a fixed state : runnable via experimental_evaluate.

Check: beginner fitness plan safety + progression

Jev judge eval (1 boolean + 1 score) over a fixed state : runnable via experimental_evaluate.

Check: recipe adaptation for allergies

Jev judge eval (1 boolean + 1 choice) over a fixed state : runnable via experimental_evaluate.

Review: vendor contract redline safety

Jev judge eval (1 boolean + 1 score) over a fixed state : runnable via experimental_evaluate.

Review: interview feedback hire signal + evidence

Jev judge eval (1 choice + 1 score) over a fixed state : runnable via experimental_evaluate.

Review: newsletter draft quality + CTA

Jev judge eval (1 boolean + 1 score) over a fixed state : runnable via experimental_evaluate.

Moderate: marketplace listing verdict + recall

Jev judge eval (1 boolean + 1 choice) over a fixed state : runnable via experimental_evaluate.

Verify: new-hire onboarding completion

Jev judge eval (2 boolean) over a fixed state : runnable via experimental_evaluate.

Review: discovery call next step + technique

Jev judge eval (1 choice + 1 score) over a fixed state : runnable via experimental_evaluate.

Audit: standup summary blockers + brevity

Jev judge eval (1 boolean + 1 score) over a fixed state : runnable via experimental_evaluate.

Audit: release notes audience + quality

Jev judge eval (1 choice + 1 score) over a fixed state : runnable via experimental_evaluate.

Audit: password-reset reply safety

Jev judge eval (1 boolean + 1 choice) over a fixed state : runnable via experimental_evaluate.

Audit: weekend itinerary feasibility + quality

Jev judge eval (1 boolean + 1 score) over a fixed state : runnable via experimental_evaluate.

Audit: invoice dispute handling

Jev judge eval (1 boolean + 1 choice) over a fixed state : runnable via experimental_evaluate.

Audit: shift handoff note completeness

Jev judge eval (1 boolean + 1 score) over a fixed state : runnable via experimental_evaluate.

Screen: product review authenticity + helpfulness

Jev judge eval (1 choice + 1 score) over a fixed state : runnable via experimental_evaluate.

Audit: damaged-item chat resolution + queue

Jev judge eval (1 boolean + 1 choice) over a fixed state : runnable via experimental_evaluate.

Audit: support transcript refund policy + tone

Jev judge eval (1 boolean + 1 score) over a fixed state : runnable via experimental_evaluate.

Grade: meeting notes usefulness

Jev judge eval (1 score) over a fixed state : runnable via experimental_evaluate.

Grade: onboarding email quality

Jev judge eval (1 score) over a fixed state : runnable via experimental_evaluate.

Grade: changelog headline strength

Jev judge eval (1 score) over a fixed state : runnable via experimental_evaluate.

Grade: marketing translation fluency

Jev judge eval (1 score) over a fixed state : runnable via experimental_evaluate.

Grade: SQL answer correctness

Jev judge eval (1 score) over a fixed state : runnable via experimental_evaluate.