The Prompting Company

Benchmark report

Blocked by a prerequisite

12m 40s elapsed

An external prerequisite prevented the documented task from completing. Benchmark again

Experience score

41/ 100

Critical Gating
  • AInstall
  • BAuth
  • DExecute
  • SDocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth B, Execute D, Docs S, Current AAInstallBAuthDExecuteSDocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
Three consecutive 10-minute benchmark-request timeouts for the API key, compounded by the proxy 403 on platform.parallel.ai blocking the documented key-minting fallback.

Where the time went

8:00 on the owner · 4:40 agent time
  • Research0:10
  • Attempt3:21
  • Verify1:09
12m 40sTotal elapsed
—Time to first success
8:00Waited on the owner

Judge reason

No live search was ever executed. /workspace/home/result.json says status=blocked, live_request_made=false, first_result=null, and no response.json/first_result.json exist in /workspace/home/parallel-search. The only live calls to the documented endpoint were unauthenticated probes returning HTTP 401 {"code":16,"message":"Invalid API key (C.1)"} (evidence/blocker-evidence.txt, transcript lines 52-53, 101-102), so there is no successful HTTP status and no nonempty results list. Setup was genuinely completed: fresh venv project, official SDK parallel-web 1.3.5 installed and imported (line 18-21), SDK signature verified by introspection (line 87-88), and search.py/search_sdk.py send the exact query 'PostgreSQL transaction isolation levels' as objective and search_queries. Nothing was mocked or fabricated. The credential was unobtainable: three benchmark-request calls returned {"outcome": "timed_out"} (lines 26, 71, 93; one earlier call rejected for invalid schema at line 68), and the documented keyless fallback at https://parallel.ai/auth.md needs platform.parallel.ai, which the proxy denied with 'CONNECT tunnel failed, response 403' (line 48) plus an interactive human browser claim.

Attempt record

  1. 6:45Asked the owner for Parallel API credentialsno response within the window
  2. 11:31Blocked by a prerequisiteParallel API key unavailable: all benchmark input requests for PARALLEL_API_KEY timed out, and the documented agent-identity key-minting fallback on platform.parallel.ai was proxy-denied (403) and requires a human browser claim.

Attempt artifacts saved.