Benchmark report

Task verified

4m 44s elapsed

The saved attempt met the documented success criterion.

Experience score

96/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current SSInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
The environment's egress proxy blocked www/docs.hyperbrowser.ai, forcing endpoint discovery through web-search snippets instead of reading the API reference directly.

Where the time went

4:44 agent time
  • Research0:19
  • Attempt2:37
  • Verify1:48
4m 44sTotal elapsed
1:43Time to first success
0:00Waited on the owner

Judge reason

Saved code (hyperbrowser_session_lifecycle.py) uses only stdlib urllib with the x-api-key header read from a private file. Artifacts show live calls at 2026-11-03T05:23:31Z: POST /api/session body {"timeoutMinutes":5} -> HTTP 200 with id 4b15b460-08ba-4531-83b2-f8627d70cfcb and launchState.timeoutMinutes=5; GET /api/session/{id} -> status "active"; GET /api/sessions?status=active&page=1 -> sessions[0].id matches (totalCount 1); PUT /api/session/{id}/stop (inside the finally: clause at line 108) -> HTTP 200 {"success": true}; final GET -> status "closed" with endTime set. The transcript tool result for the single run is byte-identical to artifacts/run_output.txt and to the printed values, so prose matches evidence. I independently confirmed via hyperbrowser.ai docs that POST /api/session with timeoutMinutes, GET /api/session/{id}, GET /api/sessions?status&page, and PUT /api/session/{id}/stop are the documented operations and that active/closed are documented statuses. No Playwright/Puppeteer/Selenium import; wsEndpoint never used. No saved file contains the API key (URLs redacted to token=<REDACTED>, header shown as <REDACTED_API_KEY>, no key-like strings found); the earlier unauthenticated probe returning 401 NOT AUTHENTICATED confirms the API was real and auth was required.

Attempt record

  1. 1:09Answered from saved key: Hyperbrowser API keyno wait
  2. —First success verified

Attempt artifacts saved.