Rerun the analysis when new data lands and send the figures that changed
For a standing research question: the dot watches a data folder, reruns the notebook on each new file, flags anomalies and sends only the figures that moved.
Jev judge eval (1 boolean) over a fixed state : runnable via experimental_evaluate.
Community-reported results. Success rates appear after 10 approved reports. Copies are deduplicated per visitor each day. Starter workflows have not been independently tested.
Jev judge eval (1 boolean) over a fixed state : runnable via experimental_evaluate.
Copy this into Muse and replace anything in [square brackets] with your own details.
// Refund chat: agent stated the amount before issuing it — Jev judge eval (typesafe-ai/jev).
// A support agent issues a $42.50 refund; the judge checks the exact amount was stated before the refund was confirmed.
// Model: typesafe-ai/jev via the Vercel AI Gateway ($0.042/1M input tokens).
// Auth: set AI_GATEWAY_API_KEY (vck_…) in the environment — never paste the key here.
// For zero-data-retention / no-training workloads, add
// providerOptions: { gateway: { … } } to the evaluate call below.
import { experimental_evaluate } from 'ai';
const result = await experimental_evaluate({
model: 'typesafe-ai/jev',
state: "Customer: My order arrived damaged, I want a refund.\nAgent: I am sorry about that. I can refund order #88121 in full: $42.50 back to your Visa ending 4412 within 3-5 business days. Shall I go ahead?\nCustomer: Yes please.\nAgent: Done — $42.50 refunded to your Visa ending 4412. Confirmation R-99210.",
questions: {
"amount_disclosed": {
"type": "boolean",
"instructions": "True only if the agent stated the exact refund amount ($42.50) before the customer approved the refund."
}
},
});
console.log(JSON.stringify(result, null, 2));
Source / inspiration: View credited source
Help the next person know what to expect.
Sign in to share your resultA question, a useful tweak, a little discovery. Start the conversation.
Sign in to join inFor a standing research question: the dot watches a data folder, reruns the notebook on each new file, flags anomalies and sends only the figures that moved.
An organized catalog of relevant datasets with access, freshness, and licensing notes.
Review what the agent will be allowed to touch: browse the web, make purchases, confirm with you first, access account settings, confirm changes first. Ask Muse to show its plan and pause before anything that spends money, sends a message or changes an account.
Reported by a Muse user on vercel.com (original post). Collected by the open-source EveryAI Muse field guide under the MIT licence. Sundog has not tested this workflow; results people report here appear on this page.