Review: vendor contract redline safety

The job

Jev judge eval (1 boolean + 1 score) over a fixed state : runnable via experimental_evaluate.

The prompt

Copy this into Muse and replace anything in [square brackets] with your own details.

// Review: vendor contract redline safety — Jev judge eval (typesafe-ai/jev).
// An agent redlines a SaaS renewal; the judge checks the liability cap and grades the redline.
// Model: typesafe-ai/jev via the Vercel AI Gateway ($0.042/1M input tokens).
// Auth: set AI_GATEWAY_API_KEY (vck_…) in the environment — never paste the key here.
// For zero-data-retention / no-training workloads, add
// providerOptions: { gateway: { … } } to the evaluate call below.

import { experimental_evaluate } from 'ai';

const result = await experimental_evaluate({
  model: 'typesafe-ai/jev',
  state: "Redline: liability capped at 12 months fees (was: uncapped); auto-renewal removed, 60-day notice; data processing addendum attached with 30-day deletion; price locked 2 years with 5% cap after.",
  questions: {
    "liability_capped": {
      "type": "boolean",
      "instructions": "True only if vendor liability is capped at a stated multiple of fees (not uncapped)."
    },
    "redline_quality": {
      "type": "score",
      "instructions": "Score this contract redline. Higher is better.",
      "criteria": [
        "Accepts uncapped liability or auto-renewal without notice.",
        "Fixes one risk but leaves liability, renewal, or data terms open.",
        "Covers liability, renewal, and data, but pricing left floating.",
        "Liability capped, renewal tamed, DPA attached, pricing locked."
      ]
    }
  },
});

console.log(JSON.stringify(result, null, 2));