The Prompting Company

Benchmark report

Task verified

8m 53s elapsed

The saved attempt met the documented success criterion.

Experience score

98/ 100

Agent-Ready
  • AInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth S, Execute S, Docs S, Current SAInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
A PEP 668 pip error needing --break-system-packages and one benchmark-request rejected for an invalid field type; both cost a single retry each.

Where the time went

8:54 agent time
  • Research0:31
  • Attempt6:24
  • Verify1:59
8m 53sTotal elapsed
4:09Time to first success
0:00Waited on the owner

Judge reason

Saved raw responses (real Cloudflare/Trace-Id/X-Ratelimit headers, api.coinbase.com) independently confirm every criterion. Best bid 73752.34 from 03_get_best_bid_ask.json; price_increment 0.01 / base_increment 1e-8 from 02_get_product.json. Three separate POST /api/v3/brokerage/orders (04-06) returned HTTP 200 success=true with client_order_ids ctrl0mo1/2/3 + shared suffix 1794456405; prices 59001.87, 58264.34, 57526.82 equal 20/21/22% below the bid floored to 0.01, sizes 0.00016949/0.00017164/0.00017384 = ceil(10/price) giving notionals 10.0002/10.0005/10.0005 USD, all post_only limit_limit_gtc BUY. 07 lists exactly those three OPEN; 08 is one POST /orders/batch_cancel with the three order_ids returning success:true for each; 09 and 13 show orders:[] on BTC-USD; 10-12 show status CANCELLED, filled_size 0, number_of_fills 0. Client code (code/cb_client.py) is hand-written urllib + ES256 JWT, no vendor SDK, credentials read from private files outside home; grep over all artifacts found no PEM, key name or JWT (only a redaction placeholder).

Attempt record

  1. 2:18Answered from saved key: Coinbase Advanced Trade API credentialsno wait
  2. —First success verified

Attempt artifacts saved.