Benchmark report

Task verified

11m 5s elapsed

The saved attempt met the documented success criterion.

Experience score

89/ 100

Agent-Ready
  • SInstall
  • AAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth A, Execute S, Docs A, Current SSInstallAAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Two small reruns: the POST /projects 400 for missing org_id, and psql -c rejecting \echo meta-commands which blanked the first proof run.

Where the time went

11:06 agent time
  • Starting0:01
  • Research0:28
  • Attempt9:05
  • Verify1:32
11m 5sTotal elapsed
2:52Time to first success
0:00Waited on the owner

Judge reason

Saved code (work/code/neonlib.py, phase_a.py, verify.py, cleanup.py) makes real urllib calls to https://console.neon.tech/api/v2 and runs stock psql 16.15 with PGSSLMODE=verify-full/PGSSLROOTCERT=system; nothing is mocked. Evidence shows POST /projects creating tpcbench-401d2e63 (divine-art-87103612), parent seeded with items (2 rows, 02-parent-seed.txt, psql exit 0), POST /projects/.../branches -> HTTP 201 creating br-proud-snow-b47adhep with parent_id br-purple-block-b4neh8cl and init_source parent-data (03-create-branch.json, confirmed by 03b GET 200). 04-branch-migration.txt shows ALTER TABLE items ADD COLUMN note / INSERT 1 on the branch endpoint only. 05-proof-branch-vs-parent.txt shows live psql output: child has_note_column=true, row_count=3, columns id/name/note; parent has_note_column=false, row_count=2, columns id/name; all four automated assertions PASS. Cleanup: DELETE branch -> 200 with suspend_compute/delete_timeline ops, follow-up GET 404 'branch not found' and list showing only the parent branch id; DELETE project -> 200, follow-up GET 404 'project not found' and project list with tpcbench_projects_remaining []. Secret hygiene verified independently: grep over all saved files and the transcript found zero npg_/napi_ strings and only ***REDACTED*** in the one connection URI; state.json holds no password.

Attempt record

  1. 4:58Answered from saved key: NEON_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.