Benchmark report
Task verified
8m 2s elapsed
The saved attempt met the documented success criterion.
91/ 100
Agent-Ready- SInstall
- AAuth
- SExecute
- SDocs
- ACurrent
The undocumented org_id requirement on POST /projects and the ~75s asynchronous compute teardown after a 200 delete, which needed a polling script.
Where the time went
8:03 agent time- Research0:19
- Attempt6:01
- Verify1:42
Judge reason
Verified against saved code and responses. work/03-http-sql.mjs uses only neon() from @neondatabase/serverless 1.2.0 (no Pool/Client, WebSocket constructor replaced by a throwing stub); evidence/03-http-sql-transcript.txt shows 4 live 'HTTP POST https://api.c-16.us-east-1.aws.neon.tech/sql -> 200' calls doing CREATE TABLE items, INSERT 2 rows RETURNING ({id:1,widget,7},{id:2,gadget,42}), SELECT returning the same two rows, plus a server-side count=2 on PostgreSQL 17.11; those rows match evidence/03-http-sql-results.json exactly. evidence/04-transport-proof.json records every socket: one tls.connect to api.c-16.us-east-1.aws.neon.tech:443 (TLS evidence) plus the sandbox's mandatory CONNECT proxy hop, zero 5432/5433 sockets, zero WebSockets. Project tpcbench-66396a86fc4a (spring-fire-84224412) was created via POST https://console.neon.tech/api/v2/projects (HTTP 201) and deleted via DELETE .../projects/spring-fire-84224412 -> HTTP 200 with body saved, confirmed gone by GET -> HTTP 404 'project not found', by absence from the org project list (0 of 46 matching), and by the HTTP SQL path itself failing with NeonDbError 'The requested endpoint could not be found' at 08:26:21Z after an honestly recorded ~75s of continued serving. No API key or DB password appears in any saved file; the only saved connection URI is '...neondb_owner:[REDACTED]@...'. Nothing is mocked or hard-coded.
Attempt record
- 0:53Answered from saved key: NEON_API_KEYno wait
- —First success verified
Attempt artifacts saved.