Benchmark report

Task verified

6m 10s elapsed

The saved attempt met the documented success criterion.

Experience score

96/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current SSInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Verbose per-subcommand --help (35KB, truncated to a persisted file) needed two filtering passes before the correct flags were readable.

Where the time went

6:10 agent time
  • Starting0:01
  • Research0:26
  • Attempt3:41
  • Verify2:03
6m 10sTotal elapsed
2:18Time to first success
0:00Waited on the owner

Judge reason

Saved CLI outputs support every criterion. commands/commands.log shows all 16 exchange calls ran as `kraken ...` (no curl/HTTP/SDK anywhere in the transcript). evidence/02-pairs-btcusd.out printed tick_size 0.1, lot_decimals 8, ordermin 0.00006/costmin 0.5; evidence/04-orderbook-bestbid.out best bid 73236.5; evidence/03-open-orders-before.out {"open":{}} (no ctrl0 order to cancel). Math checks: 73236.5*0.80=58589.2 (exact tick), 15/58589.2 rounded up to 1e-8 = 0.00025602 -> notional 15.00001 USD (15-25 range, above ordermin). evidence/07-place-order.out: mode=live, status=submitted, order_id O4YWRB-GMU7F-QW33JR with cl_ord_id ctrl0lol1794474815; stderr "live: this goes to the real Kraken account". Lookup (08) shows status open, price 58589.2, volume 0.00025602, oflags post,fciq, tif gtc. Amend via `kraken order amend --cl-ord-id ... --limit-price 57856.8 --post-only` returned amend_id TVZ64Z-FIFIQ-GWQOCA; 10-lookup-after-amend shows price 57856.8 (=73236.5*0.79 rounded down) same order id, misc=amended. Cancel ran in a trap EXIT cleanup (commands/lifecycle.sh) returning {"count":1}; 15-query-orders-retry shows status canceled, reason "User requested", volume_executed 0.0, cost 0.0, fee 0.0; 12/14 open-orders both {"open":{}}. 16-closed-orders contains exactly one order for this client order ID (other ctrl0* entries are hours older, from prior runs). No credential values appear in any saved file or output; a scan at transcript step 117 reported no leak.

Attempt record

  1. 1:39Answered from saved key: Kraken Spot API credentialsno wait
  2. —First success verified

Attempt artifacts saved.