Rerun the analysis when new data lands and send the figures that changed
For a standing research question: the dot watches a data folder, reruns the notebook on each new file, flags anomalies and sends only the figures that moved.
Jev judge eval (1 boolean) over a fixed state : runnable via experimental_evaluate.
Community-reported results. Success rates appear after 10 approved reports. Copies are deduplicated per visitor each day. Starter workflows have not been independently tested.
Jev judge eval (1 boolean) over a fixed state : runnable via experimental_evaluate.
Copy this into Muse and replace anything in [square brackets] with your own details.
// Missed delivery: agent scheduled a concrete follow-up — Jev judge eval (typesafe-ai/jev).
// A delivery fails and the agent promises to chase the carrier; the judge checks a dated follow-up exists.
// Model: typesafe-ai/jev via the Vercel AI Gateway ($0.042/1M input tokens).
// Auth: set AI_GATEWAY_API_KEY (vck_…) in the environment — never paste the key here.
// For zero-data-retention / no-training workloads, add
// providerOptions: { gateway: { … } } to the evaluate call below.
import { experimental_evaluate } from 'ai';
const result = await experimental_evaluate({
model: 'typesafe-ai/jev',
state: "Customer: My package never arrived.\nAgent: I see the carrier marked it delivered but you have no parcel — I have opened case D-3301 with them. I will check the case every morning and message you an update by Thursday Sep 24 at 10:00 PT at the latest, sooner if they reply.",
questions: {
"followup_dated": {
"type": "boolean",
"instructions": "True only if the agent committed to a follow-up with an explicit date or deadline."
}
},
});
console.log(JSON.stringify(result, null, 2));
Source / inspiration: View credited source
Help the next person know what to expect.
Sign in to share your resultA question, a useful tweak, a little discovery. Start the conversation.
Sign in to join inFor a standing research question: the dot watches a data folder, reruns the notebook on each new file, flags anomalies and sends only the figures that moved.
An organized catalog of relevant datasets with access, freshness, and licensing notes.
Review what the agent will be allowed to touch: browse the web, send messages on your behalf, submit forms and bookings. Ask Muse to show its plan and pause before anything that spends money, sends a message or changes an account.
Reported by a Muse user on vercel.com (original post). Collected by the open-source EveryAI Muse field guide under the MIT licence. Sundog has not tested this workflow; results people report here appear on this page.