The Prompting Company

Benchmark report

Blocked by a prerequisite

11m 53s elapsed

An external prerequisite prevented the documented task from completing. Benchmark again

Experience score

35/ 100

Critical Gating
  • AInstall
  • CAuth
  • DExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth C, Execute D, Docs S, Current SAInstallCAuthDExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Two unanswered benchmark-request calls (API key, then platform.parallel.ai network approval) each timed out, leaving no way to authenticate.

Where the time went

8:00 on the owner · 3:54 agent time
  • Research0:11
  • Attempt2:46
  • Verify0:56
11m 53sTotal elapsed
—Time to first success
8:00Waited on the owner

Judge reason

No live authenticated search ever succeeded. The only live calls to the documented endpoint returned HTTP 401: evidence_no_credential.txt shows POST https://api.parallel.ai/v1/search with the exact query returning {"code":16,"message":"Invalid API key (C.1)"} HTTP:401, and sdk_run_output.txt shows parallel.AuthenticationError 401 from parallel-web 1.3.5 client.search(). No response.json exists and result.json self-reports status "blocked", success false. Setup was completed: docs fetched (quickstart.md, auth.md.txt, both HTTP 200), venv created and parallel-web 1.3.5 installed and imported, and runnable search.py/search_curl.sh send the exact query 'PostgreSQL transaction isolation levels' to POST /v1/search with title/absolute-URL assertions. Credentials were unavailable: benchmark-request for the API key returned {"outcome": "timed_out"} (transcript line 32), the documented agent-auth alternative at platform.parallel.ai failed with 'curl: (56) CONNECT tunnel failed, response 403', and the network-approval request also returned timed_out (line 53). benchmark-success was never called and nothing was mocked or fabricated.

Attempt record

  1. 6:16Asked a TPC admin to allow platform.parallel.aino approval within the window
  2. 10:57Blocked by a prerequisiteNo Parallel API key could be obtained: the benchmark secret request timed out, and the documented platform.parallel.ai agent-identity fallback was unreachable (proxy 403) with its network-approval request also timing out.

Attempt artifacts saved.