Benchmark report

Blocked by a prerequisite

11m 38s elapsed

An external prerequisite prevented the documented task from completing. Benchmark again

Experience score

16/ 100

Critical Gating
  • AInstall
  • DAuth
  • DExecute
  • CDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth D, Execute D, Docs C, Current SAInstallDAuthDExecuteCDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Egress proxy 403 on every tryprofound.com host blocked all API and docs access, and two network-approval requests timed out, so no operation could run.

Where the time went

8:00 on the owner · 3:38 agent time
  • Starting0:01
  • Research0:28
  • Attempt2:05
  • Verify1:05
11m 38sTotal elapsed
—Time to first success
8:00Waited on the owner

Judge reason

No Profound product operation was executed. Every curl to tryprofound.com hosts failed at the sandbox egress proxy: outputs/raw_get_categories.txt shows 'CONNECT api.tryprofound.com:443' answered 'HTTP/1.1 403 Forbidden' (Content-Length 25, 'Destination not approved') with curl exit 56; the transcript shows the same 000/exit-56 result for www.tryprofound.com/auth.md, docs.tryprofound.com, and case/trailing-dot variants, while api.anthropic.com tunneled and returned 404, proving a per-destination allowlist denial. Two benchmark-request network-approval calls for api.tryprofound.com both returned {"outcome": "timed_out"}. Criterion (a) GET /v1/org/categories and the assets call never left the sandbox; (b) the POST /v1/reports/visibility body was only saved as outputs/planned_visibility_request.json with placeholder category_id and asset_name, never sent; (c) no {info, data} response with per-model visibility_score exists; (d) no summary naming a category, asset, or top model was written. Setup that did complete: environment/key check, the 30-day window computed as 2026-09-19 to 2026-10-18, and the fully formed request body with metrics [visibility_score, share_of_voice, mentions_count] and dimensions [model]. The agent did not call benchmark-success, reported status 'blocked', and fabricated nothing. No benchmark-first-success.json exists, so firstSuccessVerified is false.

Attempt record

  1. 6:09Asked a TPC admin to allow api.tryprofound.comno approval within the window
  2. 10:33Blocked by a prerequisiteSandbox egress proxy denies CONNECT to all tryprofound.com hostnames (HTTP 403 'Destination not approved'), and two benchmark-request network-approval attempts for api.tryprofound.com timed out, leaving the hosted API and its docs unreachable.

Attempt artifacts saved.