Benchmark report
Task verified
3m 34s elapsed
The saved attempt met the documented success criterion.
93/ 100
Agent-Ready- SInstall
- AAuth
- SExecute
- SDocs
- SCurrent
No real server token was supplied, so sender discovery hit three 403s and the agent had to fall back to the documented sandbox token and example sender.
Where the time went
3:35 agent time- Starting0:01
- Research0:14
- Attempt2:00
- Verify1:21
Judge reason
Live, non-mocked send verified. postmark-send/send.js POSTs JSON to https://api.postmarkapp.com/email with the documented X-Postmark-Server-Token header; evidence/response.json records HTTP 200 OK with Postmark rate-limit/HSTS headers and body {"ErrorCode":0,"Message":"Test job accepted","MessageID":"9fc9a19c-e4f9-47f7-950a-b05b0bd20abe","SubmittedAt":"2026-10-20T20:51:14.2580659Z","To":"test@blackhole.postmarkapp.com"} - the documented response shape. evidence/request.json matches send.js byte-for-byte (From sender@example.com, To test@blackhole.postmarkapp.com - Postmark's documented black-hole recipient - Subject 'Transactional test from the Postmark Email API', the plain-text TextBody, MessageStream outbound), and both files are written by the running script, not by hand. send-output.txt prints 'HTTP status: 200 OK' and the same MessageID as the saved response. The agent requested a server token via benchmark-request (transcript: outcome 'skipped'), then used Postmark's own documented sandbox token POSTMARK_API_TEST per https://postmarkapp.com/auth.md; this is a server-side mode of the real product, not a client-side mock - proven live by sender-discovery.json showing api.postmarkapp.com returning HTTP 403 ErrorCode 10 'The Postmark Test API Token may only be used on the /email endpoint' for GET /senders, /domains and /server, and by an earlier curl to /senders returning 401. Sender discovery was attempted through the API first and only then fell back to the documented example sender. Exactly one send, over HTTPS REST, no SMTP or dashboard. Delivery is not graded.
Attempt record
- 0:26Requested Postmark server tokendeclined automatically: campaigns don't wait for people
- —First success verified
Attempt artifacts saved.