Benchmark report

Task verified

5m 49s elapsed

The saved attempt met the documented success criterion.

Experience score

99/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current ASInstallSAuthSExecuteSDocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
Little slowed it: a 404 on docs.turso.tech/auth.md and scraping HTML docs before discovering the llms.txt markdown index cost a few calls.

Where the time went

5:50 agent time
  • Research0:36
  • Attempt3:41
  • Verify1:33
5m 49sTotal elapsed
2:28Time to first success
0:00Waited on the owner

Judge reason

Saved code and live responses support every criterion. work/code/phase1.js created parent tpcbench-818c1d83a297 (03-create-parent.json, 200) and branched it via the documented POST /v1/organizations/rickchen/databases with seed {type:database,name:parent} (06-create-branch.json, 200, Hostname tpcbench-818c1d83a297-branch-rickchen.aws-ap-northeast-1.turso.io); branch_at_creation shows the inherited 2 rows, proving a real seed. Connected with the stock @libsql/client over libsql:// using short-lived per-DB JWTs from the auth/tokens endpoint. 07-branch-vs-parent-verification.json and phase1-console.log show branch PRAGMA table_info with id/name/note, CREATE TABLE ... note TEXT, 3 rows (gamma 'added on branch only'), and parent with id/name only and 2 rows. Cleanup: DELETE branch and parent both 200 with {"database":...}, follow-up GETs both 404 'record not found', and 11-list-after-delete.json contains zero tpcbench entries. Secrets: grep found no eyJ-style JWT anywhere; both create responses show "password": "<REDACTED>" and token responses "jwt": "<REDACTED>"; management token read from a file path env var, never printed. No mocking or hard-coded responses.

Attempt record

  1. 1:52Answered from saved key: TURSO_API_TOKENno wait
  2. —First success verified

Attempt artifacts saved.