Benchmark report

Task verified

3m 34s elapsed

The saved attempt met the documented success criterion.

Experience score

93/ 100

Agent-Ready
  • SInstall
  • AAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth A, Execute S, Docs S, Current SSInstallAAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
No real server token was supplied, so sender discovery hit three 403s and the agent had to fall back to the documented sandbox token and example sender.

Where the time went

3:35 agent time
  • Starting0:01
  • Research0:14
  • Attempt2:00
  • Verify1:21
3m 34sTotal elapsed
1:21Time to first success
0:00Waited on the owner

Judge reason

Live, non-mocked send verified. postmark-send/send.js POSTs JSON to https://api.postmarkapp.com/email with the documented X-Postmark-Server-Token header; evidence/response.json records HTTP 200 OK with Postmark rate-limit/HSTS headers and body {"ErrorCode":0,"Message":"Test job accepted","MessageID":"9fc9a19c-e4f9-47f7-950a-b05b0bd20abe","SubmittedAt":"2026-10-20T20:51:14.2580659Z","To":"test@blackhole.postmarkapp.com"} - the documented response shape. evidence/request.json matches send.js byte-for-byte (From sender@example.com, To test@blackhole.postmarkapp.com - Postmark's documented black-hole recipient - Subject 'Transactional test from the Postmark Email API', the plain-text TextBody, MessageStream outbound), and both files are written by the running script, not by hand. send-output.txt prints 'HTTP status: 200 OK' and the same MessageID as the saved response. The agent requested a server token via benchmark-request (transcript: outcome 'skipped'), then used Postmark's own documented sandbox token POSTMARK_API_TEST per https://postmarkapp.com/auth.md; this is a server-side mode of the real product, not a client-side mock - proven live by sender-discovery.json showing api.postmarkapp.com returning HTTP 403 ErrorCode 10 'The Postmark Test API Token may only be used on the /email endpoint' for GET /senders, /domains and /server, and by an earlier curl to /senders returning 401. Sender discovery was attempted through the API first and only then fell back to the documented example sender. Exactly one send, over HTTPS REST, no SMTP or dashboard. Delivery is not graded.

Attempt record

  1. 0:26Requested Postmark server tokendeclined automatically: campaigns don't wait for people
  2. —First success verified

Attempt artifacts saved.