Benchmark report

Task verified

6m 33s elapsed

The saved attempt met the documented success criterion.

Experience score

89/ 100

Agent-Ready
  • SInstall
  • AAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth A, Execute S, Docs A, Current SSInstallAAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
api.neon.tech being blocked by the egress proxy forced host probing, plus a 400 'org_id is required' for the org-scoped key and one self-inflicted bash unbound-variable bug.

Where the time went

6:34 agent time
  • Research0:22
  • Attempt4:57
  • Verify1:14
6m 33sTotal elapsed
3:20Time to first success
0:00Waited on the owner

Judge reason

Saved scripts + verbatim API/psql output prove the full task. 01_create_project.txt: POST /projects -> 201 project tpcbench-20261110004959-b01f0f5e (super-recipe-24820580), default branch main br-noisy-night-bdadxzyv. 02_seed_parent.txt: items(id,name) + rows alpha/beta over psql with sslmode=verify-full&sslrootcert=system. 03_create_branch.txt: POST /projects/{id}/branches with branch.parent_id -> 201, parent_id=br-noisy-night-bdadxzyv, parent_lsn=0/1970508, init_source=parent-data — Neon's documented copy-on-write branch (neon.com/docs/manage/branches), not a copy; 04_migrate_branch.txt shows the branch already held rows 1-2 before any write, so no non-inheritance citation was needed. ALTER TABLE items ADD COLUMN note + one insert ran on the branch only. 05_compare_parent_vs_branch.txt: parent has_note_column=f, 2 rows; branch has_note_column=t, 3 rows; \conninfo on both reports TLSv1.3/TLS_AES_256_GCM_SHA384, plus a negative control where verify-full against an unrelated CA is rejected ('certificate verify failed'). 06_cleanup.txt: DELETE branch -> 200 then GET -> 404 'branch not found' and branch list shows only main; DELETE project -> 200 then GET -> 404 'project not found' and org list has 0 tpcbench-* projects. All saved URIs are neondb_owner:REDACTED@...; a full-tree grep found no API key or unredacted password. api.neon.tech was blocked by the environment proxy, so the agent used Neon's other documented v2 base console.neon.tech/api/v2; transcript tool results match the saved files, no fabrication.

Attempt record

  1. 0:41Answered from saved key: NEON_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.