Benchmark report

Task verified

3m 19s elapsed

The saved attempt met the documented success criterion.

Experience score

98/ 100

Agent-Ready
  • AInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth S, Execute S, Docs S, Current SAInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
The PEP 668 externally-managed-environment block on the first pip install, plus one correction from a guessed client.beta.search to the real client.search method.

Where the time went

3:19 agent time
  • Research0:12
  • Attempt1:55
  • Verify1:11
3m 19sTotal elapsed
1:18Time to first success
0:00Waited on the owner

Judge reason

Saved code /workspace/home/parallel-search/search.py calls the official parallel-web 1.3.7 SDK (client.with_raw_response.search) against the documented POST https://api.parallel.ai/v1/search with x-api-key, sending the exact query 'PostgreSQL transaction isolation levels' as both objective and the single search_queries entry. response_headers.json records http_status 200 with live Cloudflare headers (cf-ray a5b773159ce5dfd2-PDX, date Mon, 16 Nov 2026 15:15:11 GMT, x-request-id df65903221b958d087c718d99385a67d matching search_id search_df65903221b958d087c718d99385a67d). response.json holds the documented shape (search_id, results[], warnings, usage, metadata, session_id) with 10 results; results[0] has title 'PostgreSQL: Documentation: 18: 13.2. Transaction Isolation', absolute URL https://www.postgresql.org/docs/current/transaction-iso.html, and a nonempty excerpts[0] beginning '**Table 13.1. Transaction Isolation Levels**'. run_output.txt prints exactly those three values and they match the raw body byte-for-byte. The key was read at runtime from a private file, never hard-coded; no mock or fabricated response anywhere.

Attempt record

  1. 1:05Answered from saved key: Parallel API keyno wait
  2. —First success verified

Attempt artifacts saved.