The Prompting Company

Benchmark report

Blocked by a prerequisite

11m 29s elapsed

An external prerequisite prevented the documented task from completing. Benchmark again

Experience score

4/ 100

Critical Gating
  • DInstall
  • DAuth
  • DExecute
  • CDocs
  • DCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install D, Auth D, Execute D, Docs C, Current DDInstallDAuthDExecuteCDocsDCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Proxy-denied egress to every invideo host, compounded by two benchmark-request host approvals that each timed out after minutes of waiting.

Where the time went

8:00 on the owner · 3:30 agent time
  • Starting0:01
  • Research0:34
  • Attempt1:51
  • Verify1:04
11m 29sTotal elapsed
—Time to first success
8:00Waited on the owner

Judge reason

No product use occurred. The transcript shows only reachability probes: curl to https://invideo.io/agents.md and POST https://mcp.invideo.io/mcp both returned exit 56 / http_code 000, and evidence/blocker-network.txt captures verbatim proxy CONNECT refusals ('> CONNECT mcp.invideo.io:443' -> '< HTTP/1.1 403 Forbidden', body 'Destination not approved') for invideo.io, mcp.invideo.io, www.invideo.io and api.invideo.io, while the control host api.anthropic.com returned '200 Connection Established' (and 401 from /v1/models), proving the proxy itself was healthy. Two benchmark-request network-approval requests (invideo.io, mcp.invideo.io) each returned {"outcome": "timed_out"}. No TLS session, no JSON-RPC initialize/tools/list, no get_help output, no project creation, no timeline edit, and no verification read exist; home/result.json itself marks every success criterion unmet with status 'blocked'. Setup credit: the agent correctly identified the mandatory egress proxy, used the documented endpoint https://mcp.invideo.io/mcp, and isolated the denial with a control host, but never reached the product.

Attempt record

  1. 6:23Asked a TPC admin to allow mcp.invideo.iono approval within the window
  2. 10:26Blocked by a prerequisiteNetwork egress to all invideo hostnames is denied by the mandatory credential proxy (CONNECT -> HTTP/1.1 403 'Destination not approved'), with host-approval requests timing out; the control host api.anthropic.com tunneled successfully, confirming the denial is an allowlist decision outside the agent's control.

Attempt artifacts saved.