The Prompting Company

Benchmark report

Blocked by a prerequisite

10m 23s elapsed

An external prerequisite prevented the documented task from completing. Benchmark again

Experience score

46/ 100

Critical Gating
  • AInstall
  • AAuth
  • DExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth A, Execute D, Docs A, Current SAInstallAAuthDExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
The sandbox egress proxy blocked api.tavily.com with 403 'Destination not approved'; probing it and waiting on a timed-out allowlist request consumed the rest of the attempt.

Where the time went

6:51 on the owner · 3:32 agent time
  • Starting0:01
  • Research0:10
  • Attempt2:13
  • Verify1:08
10m 23sTotal elapsed
—Time to first success
6:51Waited on the owner

Judge reason

No successful Tavily search exists in the evidence. evidence/tavily_search_response.json is 0 bytes and evidence/tavily_search_stderr.txt shows requests.exceptions.ProxyError on POST https://api.tavily.com/search ('Tunnel connection failed: 403 Forbidden') from tavily/tavily.py search(), so no structured response with the query 'Who is Leo Messi?' or a non-empty results list was ever printed. Setup did complete and is documented: venv created, official tavily-python 0.8.4 installed from PyPI (evidence/sdk_installed.txt), API key obtained via benchmark-request (outcome: provided) and read from its private file, and tavily_quickstart.py written with the documented TavilyClient(...).search('Who is Leo Messi?') snippet, run 3x (transcript entries 18, 22, 57). The cause is the sandbox egress proxy, not agent error: a raw CONNECT probe returned 'HTTP/1.1 403 Forbidden / Destination not approved' for api.tavily.com and docs.tavily.com while pypi.org returned 200 Connection Established, direct non-proxy curl gave exit 000, and the benchmark-request to allowlist api.tavily.com:443 timed out. No mock was used and the agent correctly did not run benchmark-success.

Attempt record

  1. 3:36Asked the owner to act: Approve network egress to api.tavily.comno response within the window
  2. 9:16Blocked by a prerequisiteSandbox egress proxy denies CONNECT to api.tavily.com:443 ('Destination not approved'); the allowlist request timed out and Tavily serves its API only from that host, so no official alternative path exists.

Attempt artifacts saved.