Benchmark report

Blocked by a prerequisite

12m 33s elapsed

An external prerequisite prevented the documented task from completing. Benchmark again

Experience score

30/ 100

Critical Gating
  • SInstall
  • CAuth
  • DExecute
  • BDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth C, Execute D, Docs B, Current SSInstallCAuthDExecuteBDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Deny-by-default egress proxy returning 403 'Destination not approved' for behavehealth.com, compounded by two host-approval requests that hung ~300s and ~180s before timing out.

Where the time went

8:00 on the owner · 4:34 agent time
  • Starting0:01
  • Research0:28
  • Attempt2:42
  • Verify1:23
12m 33sTotal elapsed
—Time to first success
8:00Waited on the owner

Judge reason

No mbc-brief.md exists anywhere in /workspace/home (only commands.md, evidence/blocker.md, outputs/ with two 403 captures), so none of the success criteria (three-measure table, per-page verbatim quotes, four fetched behavehealth.com/assessments URLs, closing intake-vs-follow-up section) are met. The transcript shows every retrieval of the product pages failed: WebFetch on /assessments/outcome-measure-library and /assessments/gad-7 returned 'proxy refused the connection'; curl to https://behavehealth.com and https://www.behavehealth.com returned 'curl: (56) CONNECT tunnel failed, response 403' (http=000); plain HTTP to http://behavehealth.com/assessments/phq-9 returned http=403 with body 'Destination not approved' (saved in outputs/http-403-behavehealth-phq9.txt). Two benchmark-request network approvals for behavehealth.com and www.behavehealth.com both returned {"outcome": "timed_out"}. Setup that did complete is acknowledged: working/evidence dirs prepared, the plan's auth.md probe attempted, no-auth-needed confirmed for these public pages, and deny-by-default egress verified by a baseline https://example.com check also failing. The only working channel was server-side WebSearch, which returned model-written summaries mixed with NCBI/PMC third-party sources even with allowed_domains set to behavehealth.com; the agent correctly declined to fabricate attributed verbatim quotes from it and produced no brief. No benchmark-first-success.json exists and benchmark_success_invoked is false.

Attempt record

  1. 6:21Asked a TPC admin to allow www.behavehealth.comno approval within the window
  2. 11:11Blocked by a prerequisiteSandbox egress proxy is deny-by-default and rejects the product hostname: HTTP 403 'Destination not approved' for behavehealth.com and www.behavehealth.com, with both host-approval requests timing out unanswered, making all four required public pages unreachable.

Attempt artifacts saved.