Benchmark report

Blocked by a prerequisite

3m 38s elapsed

An external prerequisite prevented the documented task from completing. Benchmark again

Experience score

14/ 100

Critical Gating
  • AInstall
  • DAuth
  • DExecute
  • CDocs
  • BCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth D, Execute D, Docs C, Current BAInstallDAuthDExecuteCDocsBCurrent
Agent profile · this run
Judge's note · what slowed the agent most
The egress proxy's blanket 403 on peakmv.com, plus a 'skipped' host-approval request, blocked the agent at the first doc fetch and made every later step impossible.

Where the time went

0:40 on the owner · 2:59 agent time
Waited on the owner 0:40
  • Starting0:02
  • Research0:25
  • Attempt1:21
  • Verify1:12
3m 38sTotal elapsed
—Time to first success
0:40Waited on the owner

Judge reason

No product use occurred. Saved evidence (evidence/commands-and-outputs.txt, transcript turns 4-23) shows every HTTPS request to peakmv.com and www.peakmv.com failing at the egress proxy with 'curl: (56) CONNECT tunnel failed, response 403', http_code=000, before TLS: auth.md, llms-full.txt, and POST /api/v3/generate all failed. A control request to https://api.anthropic.com/ returned 404 through the same proxy, so the proxy works and the denial is host-specific. The agent requested network approval for peakmv.com via benchmark-request and received {"outcome":"skipped"}. Completed setup is acknowledged: working directory prepared, the exact POST body composed verbatim (lighthouse prompt, duration_seconds 15, aspect_ratio 16:9, 1080p, camera_rig) in evidence/request-body.json, and a submit-then-poll procedure scripted in evidence/planned-procedure.md. But there is no accepted POST, no job_id, no status_url, no authenticated GET to /api/v3/jobs/{job_id}, and no video_url. The agent correctly declined to mock or substitute the service and did not claim success. Success criteria unmet.

Attempt record

  1. 0:47Asked a TPC admin to allow peakmv.comwaited 40s · denied
  2. 2:27Blocked by a prerequisiteNetwork egress to peakmv.com is not permitted from the environment: the mandatory proxy rejects CONNECT with 403 for peakmv.com and www.peakmv.com while other hosts succeed, and the agent's host-approval request returned outcome 'skipped', so no request could reach the PeakMV API.

Attempt artifacts saved.