Benchmark report

Task verified

3m 38s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Nothing material — docs read, key request and the full live lifecycle completed in ~77s with no retries or errors.

Where the time went

3:38 agent time
  • Starting0:01
  • Research0:15
  • Attempt2:06
  • Verify1:17
3m 38sTotal elapsed
1:17Time to first success
0:00Waited on the owner

Judge reason

Saved stdlib-Python script run_domain_flow.py makes real HTTPS calls to https://api.agentmail.to/v0 with a bearer key read from a private file (never printed). Evidence files show the full live lifecycle for tpc-bench-11d8e0e7.example.com: 01_create.json POST /v0/domains -> HTTP 200 with domain_id 'tpc-bench-11d8e0e7.example.com', status NOT_STARTED and 5 DNS records (DKIM TXT, MX inbound-smtp.us-east-1.amazonaws.com pri 10, MX feedback-smtp.us-east-1.amazonses.com pri 10, SPF TXT, DMARC TXT) all listed in REPORT.md with type/name/value; 02_get.json GET -> 200 records MISSING; 03_verify.json POST /{id}/verify -> HTTP 204; 04_get_status.json GET -> 200 status PENDING, reason dns_records_missing; 05_delete.json DELETE -> 204; 06_get_after_delete.json GET -> 404 NotFoundError 'Domain not found' confirming deletion. Report states PENDING and never claims verified. No dashboard or SMTP steps; nothing mocked or hard-coded.

Attempt record

  1. 0:54Answered from saved key: AGENTMAIL_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.