Benchmark report
Task verified
4m 55s elapsed
The saved attempt met the documented success criterion.
96/ 100
Agent-Ready- SInstall
- SAuth
- SExecute
- ADocs
- SCurrent
Two 404s on guessed doc paths before WebSearch found the real stop/Playwright pages, plus one PEP 668 pip failure needing a venv.
Where the time went
4:55 agent time- Research0:18
- Attempt3:17
- Verify1:20
Judge reason
Saved code work/browser_use_session.py calls the documented POST https://api.browser-use.com/api/v4/browsers with the X-Browser-Use-API-Key header; evidence/create_session_response.json shows httpStatus 201 with id 9d0a10e8-d126-4a63-a915-2b85a7ad98d9, status active and cdpUrl https://9d0a10e8-....cdp.browser-use.com (no credential in the URL). run_output.txt from the single live run (transcript idx 63-64, EXIT=0) shows Playwright chromium.connect_over_cdp on that URL, page.url() https://example.com/ and PAGE TITLE 'Example Domain'. Termination runs in a finally block via the documented PATCH /api/v4/browsers/{id} {"action":"stop"}; stop_session_response.json shows httpStatus 200, status stopped, finishedAt 2026-11-09T10:04:27.525636Z. Printed values match the saved responses, docs fetched (create-browser-session, update-browser-session, playwright-puppeteer-selenium) confirm the operations and that no header is required on the CDP connection, and no saved file contains the key (only <REDACTED_API_KEY>/liveUrl wss redacted; agent's scan found 0 hits). Nothing mocked or hard-coded. Setup also clean: venv + pip install playwright succeeded after the system pip PEP 668 refusal.
Attempt record
- 1:39Answered from saved key: BROWSER_USE_API_KEYno wait
- —First success verified
Attempt artifacts saved.