Benchmark report

Task verified

8m 44s elapsed

The saved attempt met the documented success criterion.

Experience score

91/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • BDocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs B, Current ASInstallSAuthSExecuteBDocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
Kraken docs show cl_ord_id for QueryOrders, but the live API returned EGeneral:Invalid arguments without txid, aborting the first run and forcing a second order chain.

Where the time went

8:44 agent time
  • Starting0:01
  • Research0:28
  • Attempt6:15
  • Verify2:01
8m 44sTotal elapsed
3:39Time to first success
0:00Waited on the owner

Judge reason

Saved stdlib-only code (code/kraken_client.py HMAC-SHA512 signing, ns nonce, headers only) and ten HTTP-200 live responses support every step for cl_ord_id ctrl0lol1794445807. 01 AssetPairs printed tick 0.1, lot 1e-8, ordermin 0.00006; 02 Depth best bid 73720.70; 03 preflight showed 0 ctrl0 open orders; 04 AddOrder returned txid OWP4VA-3VE5X-QEXTFZ at price 58976.5 (73720.70*0.80=58976.56, floored, within one increment) size 0.00025434 = 15.0001 USD; 05 OpenOrders lookup by cl_ord_id shows open, 58976.5, post+gtc, vol_exec 0 (direct QueryOrders by cl_ord_id alone is rejected EGeneral:Invalid arguments, responses-attempt1/01, so the allowed listing path was used); 06 AmendOrder returned amend_id TSAMEO-T2SOD-5HXDM6 and 07 confirms price 58239.3 (73720.70*0.79=58239.353, floored); 08 CancelOrder in the finally block count 1; 09 QueryOrders shows status canceled, vol_exec 0.00000000, cost/fee 0; 10 OpenOrders is empty. An earlier run under a different cl_ord_id (ctrl0lol1794445732) aborted at the lookup and its order ORAGXM-3NAVZ-WMT4ZY is confirmed canceled with vol_exec 0 (responses-attempt1/02), so nothing remains open and no fill occurred. No credential-like strings appear in any saved file; no mocks or hard-coded responses.

Attempt record

  1. 0:55Answered from saved key: Kraken Spot REST API credentialsno wait
  2. —First success verified

Attempt artifacts saved.