Benchmark report

Task verified

6m 18s elapsed

The saved attempt met the documented success criterion.

Experience score

89/ 100

Agent-Ready
  • SInstall
  • AAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth A, Execute S, Docs A, Current SSInstallAAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Credential env-var names and the us API host were undocumented in --help, so the agent grepped the minified dist/index.js bundle to confirm them.

Where the time went

6:19 agent time
  • Research0:29
  • Attempt3:55
  • Verify1:54
6m 18sTotal elapsed
2:46Time to first success
0:00Waited on the owner

Judge reason

Saved CLI outputs verify every criterion. OKX US lists no BTC-USD spot (evidence/…, error 51001), so BTC-USDC was used; instrument call printed tickSz 0.1, lotSz 0.00000001, minSz 0.00001 and orderbook best bid 73603.5. Pre-order open-order listing was [] (no ctrl0 order to cancel). Three separate `okx spot place` calls (commands.log 04:34:12-13) placed post_only buy orders px 58882.8 / 58146.7 / 57410.7 — exactly 20/21/22% below 73603.5 floored to 0.1 — sizes 0.00016983/0.00017198/0.00017419 (notionals 10.0001/10.0001/10.0004 USDC, each >=10 and <11), clOrdIds ctrl0mo1/2/3 + shared suffix 1794458025, each returning sCode 0 and a distinct ordId. evidence/30 lists all three state=live. A single `okx spot batch --action cancel` returned sCode 0 for all three at ts 1794458054062; evidence/50 shows [] open, evidence/60 fills [], and per-order gets show state=canceled, accFillSz 0, 'Order was canceled by you.' Verbose output confirms live mode (GET https://us.okx.com/api/v5/..., demo=false) with a real 75 USDC balance. Every exchange call went through the okx CLI via a wrapper that exported OKX_API_KEY/OKX_SECRET_KEY/OKX_PASSPHRASE/OKX_SITE=us; no HTTP, SDK or MCP call appears in the transcript. Credentials are masked in all logs and a scan of 46 files found 0 secret occurrences. A finally/trap cleanup re-checked each clOrdId after the run.

Attempt record

  1. 1:58Answered from saved key: OKX API credentialsno wait
  2. —First success verified

Attempt artifacts saved.