Grade: technical explanation clarity

The job

Jev judge eval (1 score) over a fixed state : runnable via experimental_evaluate.

The prompt

Copy this into Muse and replace anything in [square brackets] with your own details.

// Grade: technical explanation clarity — Jev judge eval (typesafe-ai/jev).
// An agent explains DNS propagation to a non-technical user; the judge scores clarity.
// Model: typesafe-ai/jev via the Vercel AI Gateway ($0.042/1M input tokens).
// Auth: set AI_GATEWAY_API_KEY (vck_…) in the environment — never paste the key here.
// For zero-data-retention / no-training workloads, add
// providerOptions: { gateway: { … } } to the evaluate call below.

import { experimental_evaluate } from 'ai';

const result = await experimental_evaluate({
  model: 'typesafe-ai/jev',
  state: "Answer: DNS changes need time to propagate because resolvers cache records per their TTL. Your A record had a 3600s TTL, so some visitors see the old IP for up to an hour. Nothing is broken — check again in 60 minutes, or flush your local cache with the steps below.",
  questions: {
    "clarity": {
      "type": "score",
      "instructions": "Score how clearly this explains the issue to a non-technical user. Higher is better.",
      "criteria": [
        "Jargon-only; a non-technical user learns nothing.",
        "Correct but assumes background the user likely lacks.",
        "Understandable with slight jargon, gives a timeline.",
        "Plain language, concrete timeline, reassurance, and a next step."
      ]
    }
  },
});

console.log(JSON.stringify(result, null, 2));