Help

Score a captured transcript

Send the transcript of a call your voice agent already had, with what the call was meant to achieve, and get a scored run back. No call is placed.

Steps

  1. In Studio, open Tests and go to Score a Transcript.
  2. Write the scenario goal: what the call was supposed to achieve. The outcome layer is judged against it.
  3. Paste the transcript. Put each turn on its own line, starting with AGENT: or CALLER:.
  4. Add assertions if you want, one per line. For example: Agent confirms the appointment time.
  5. Press Score with the judge. Or send the same three fields to POST /api/tests/run.
    curl -s -X POST https://api.wordis-bond.com/api/tests/run \
      -H "Authorization: Bearer $TOKEN" \
      -H "Content-Type: application/json" \
      -d '{
        "scenarioGoal": "Book the caller a cleaning and confirm the time",
        "transcript": "AGENT: Bright Smile Dental, how can I help?\nCALLER: I need a cleaning.\nAGENT: Tuesday at 9 is open. You are booked for Tuesday at 9.",
        "assertions": ["Agent confirms the appointment time"]
      }' | jq '.data | {id, status, score, passed}'

What you get

A completed run with a score out of 100, pass or fail, and the four-layer scorecard. It is listed with your other runs under Tests.

If something fails

StatusCodeMessageWhat it means
422VALIDATION_ERRORtargetAgent.transport is required for a live run (or send only "suiteId" to run a saved suite)The transcript field is missing or empty, so the request was read as a live call. Send the transcript.
400—Invalid JSON in request bodyThe body is not valid JSON. Check the quotes and the line breaks in the transcript.
429RATE_LIMITEDToo many scoring requests — slow down (30 per minute).Wait a minute, then score again.

Not ready yet

  • A plain transcript carries no timing, so latency and barge-ins are not measured for it.

Last checked 2026-10-11. More help: Sign up and run your first test · Read a scorecard · Run a suite from CI · Schedule a suite.