Benchmark report

Task verified

5m 43s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Only minor: the SQL-over-HTTP pages are not listed near the API reference, so the agent had to grep llms.txt a second time for 'pipeline|hrana' to find them.

Where the time went

5:43 agent time
  • Starting0:01
  • Research0:17
  • Attempt3:55
  • Verify1:31
5m 43sTotal elapsed
2:06Time to first success
0:00Waited on the owner

Judge reason

Independently verified from saved code, logs and responses. code/01-create-and-query.mjs created tpcbench-1656f17e via POST https://api.turso.tech/v1/organizations/rickchen/databases (artifacts/01-create-database.json, HTTP 200), minted a 1h db auth token (02, jwt redacted), then ran CREATE TABLE items, two parameterized INSERTs (affected_row_count 1 each, last_insert_rowid 1 and 2) and SELECT id,name,qty FROM items ORDER BY id over POST https://tpcbench-1656f17e-rickchen.aws-ap-northeast-1.turso.io/v2/pipeline (artifacts/03/04/05, all HTTP 200). 05-select-rows.json returns rows_read=2 with values (1,widget,7) and (2,gadget,42), matching the printed table in run-01-create-and-query.log and 06-rows-readback.json. Transport is HTTP only: all four .mjs files import solely node:fs/node:path and every outbound call is fetch() to an https:// URL; my own grep for libsql://, ws(s)://, net/tls.connect, WebSocket found only a comment, no socket code. Cleanup is complete and real: DELETE returned 200 {"database":"tpcbench-1656f17e"} (07), follow-up GET of the database returned 404 'record not found' (08), the org list no longer contains the name (09), and the same pipeline SELECT now returns 404 'Namespace 01a19a48-... doesn't exist' (10) — run-02-cleanup.log shows these live. No secrets leaked: my own scan of /workspace/home for JWT-shaped strings and non-empty "password" values found zero hits; the create response's password field is literally "" and no connection string was used. Nothing mocked or hard-coded; responses carry server-side fields (DbId, query_duration_ms, replication_index) consistent across log and artifacts.

Attempt record

  1. 1:10Answered from saved key: TURSO_API_TOKENno wait
  2. —First success verified

Attempt artifacts saved.