Benchmark report

Task verified

3m 6s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Essentially nothing: first success at ~47s on the first API call, with only doc fetches and one key request beforehand.

Where the time went

3:06 agent time
  • Research0:21
  • Attempt1:32
  • Verify1:13
3m 6sTotal elapsed
0:47Time to first success
0:00Waited on the owner

Judge reason

Transcript shows the documented path end-to-end: WebFetch of https://docs.apollo.io/reference/organization-enrichment and /reference/authentication (x-api-key header), key obtained via benchmark-request (outcome 'provided', value kept in /tmp/benchmark-control/... outside home), then a single live run of apollo/enrich_stripe.py (stdlib urllib, GET https://api.apollo.io/api/v1/organizations/enrich?domain=stripe.com, key read from file into the x-api-key header). Tool result at step 16 printed 'HTTP status: 200' with name Stripe, website_url http://www.stripe.com, primary_domain stripe.com, industry 'information technology & services', employees 9400 — byte-identical to saved apollo/printed_output.txt. The saved 58,172-byte apollo/organizations_enrich_response.json is the real body written by the script: top-level {"organization": {...}} with 63 fields including id 5d0a0fbff6512580bf33a120, linkedin_url, founded_year 2010, and exactly the five printed values, so printed output matches the saved response. Identification was by domain, which the docs allow. No mock or hard-coding. My grep over all saved files found no access_token/bearer token and no key-like string; the agent's own in-run substring scan against the actual key reported zero matches across 8 artifacts, and the response contains no access_token field (so no redaction was due).

Attempt record

  1. 0:49Answered from saved key: Apollo.io API keyno wait
  2. —First success verified

Attempt artifacts saved.