Benchmark report

Task verified

4m 50s elapsed

The saved attempt met the documented success criterion.

Experience score

94/ 100

Agent-Ready
  • AInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth S, Execute S, Docs A, Current SAInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
The PEP 668 externally-managed-environment pip failure forced a venv detour; docs gaps (no stop example, no CDP auth statement) needed a judgment call.

Where the time went

4:50 agent time
  • Starting0:01
  • Research0:23
  • Attempt2:31
  • Verify1:56
4m 50sTotal elapsed
—Time to first success
0:00Waited on the owner

Judge reason

Transcript shows one real end-to-end run (no retries): POST https://api.browser-use.com/api/v4/browsers with header X-Browser-Use-API-Key -> HTTP 201, session id 45f1e958-316f-41ab-bd68-007adb448480, status active, cdpUrl present (printed redacted). Playwright chromium.connect_over_cdp(cdpUrl, headers={'X-Browser-Use-API-Key': ...}) connected to remote Chrome 156.0.8078.79, opened https://httpbin.org/forms/post, filled custname/custtel, clicked Submit order, and httpbin echoed form {"custname":"Benchmark Test","custtel":"555-0100"} from origin 66.93.139.221 with a macOS Chrome 156 UA - i.e. driven in the hosted browser, not locally. The finally block ran the documented stop op PATCH /api/v4/browsers/{id} {"action":"stop"} -> HTTP 200, status "stopped", finishedAt 2026-11-09T06:14:30Z. Saved code (work/run_task.py, shown verbatim in the transcript) reads the key from a private file path, never into a URL/query, and scrubs cdpUrl/liveUrl in artifacts; a literal grep for the key across the home dir returned clean. The printed JSON matches the saved echoed_form_response.json. No mocking or hard-coded responses. The /workspace/home snapshot is truncated (162K, 100 files, venv itself incomplete) so run_task.py and work/evidence/*.json are absent from the copy, but their creation, contents and runtime output are fully preserved in the transcript.

Attempt record

  1. 1:30Answered from saved key: BROWSER_USE_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.