Benchmark report

Blocked by a prerequisite

5m 38s elapsed

An external prerequisite prevented the documented task from completing. Benchmark again

Experience score

38/ 100

Critical Gating
  • SInstall
  • CAuth
  • DExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth C, Execute D, Docs S, Current SSInstallCAuthDExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
The saved account token was rejected with 401 ErrorCode 10, costing the agent probes across both headers, alternate decodings and a re-request before stopping.

Where the time went

5:39 agent time
  • Research0:15
  • Attempt4:06
  • Verify1:17
5m 38sTotal elapsed
—Time to first success
0:00Waited on the owner

Judge reason

No part of the domain lifecycle executed. The only live API evidence (postmark-domains/evidence/api-transcript.json, run-output.txt) is POST https://api.postmarkapp.com/domains {"Name":"tpc-bench-cdf9149b.example.com"} -> HTTP 401 {"ErrorCode":10,"Message":"Request does not contain a valid Account token."}, so there is no domain ID, no DNS records, no verification call, no status read-back and no deletion response. Setup was genuinely completed and is acknowledged: the agent fetched https://postmarkapp.com/auth.md and the Domains API reference (saved as auth.md, domains-api.html), confirmed the account-level X-Postmark-Account-Token header, mapped create/details/verifyDkim/verifyReturnPath/verifyspf/delete endpoints, and wrote a complete stdlib-only lifecycle script (postmark-domains/verify_domain.py) that prints every DNS record as type/name/value and the final status. The credential supplied by the benchmark input mechanism (46 chars) was probed against /domains, /servers with X-Postmark-Account-Token and /server with X-Postmark-Server-Token and returned 401 ErrorCode 10 on all three (evidence/auth-probe.json); a second request returned a byte-identical value with the same rejection (transcript entries 99-102). Postmark's own auth.md states account tokens are issued only through the human UI and that 401/ErrorCode 10 is terminal, and offers no sandbox route for /domains (POSTMARK_API_TEST covers sending endpoints only), so the blocker is documentation-supported. Nothing was mocked or fabricated and the report correctly claims nothing as verified.

Attempt record

  1. 2:58Answered from saved key: POSTMARK_ACCOUNT_API_TOKEN (valid account-level token)no wait
  2. 4:21Blocked by a prerequisiteThe Postmark Account API token returned by the benchmark input mechanism is invalid: every live call returns HTTP 401 ErrorCode 10 under both documented auth headers, and Postmark documents no API route to obtain or substitute an account-level token.

Attempt artifacts saved.