Benchmark report

Task verified

5m 29s elapsed

The saved attempt met the documented success criterion.

Experience score

96/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current SSInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Apollo publishes no industry taxonomy list, so 'software development' silently returned 0 results and an enrichment round-trip was needed to find the 'computer software' tag id.

Where the time went

5:30 agent time
  • Research0:22
  • Attempt3:03
  • Verify2:05
5m 29sTotal elapsed
1:51Time to first success
0:00Waited on the owner

Judge reason

Saved code apollo/code/apollo_org_search.py POSTs to the documented https://api.apollo.io/api/v1/mixed_companies/search with x-api-key read from a private file, and the saved live response (apollo/responses/org_search_page1.json, echoed in evidence_org_search_success.txt) is HTTP 200 in the documented shape. Filtering was server-side: the response breadcrumbs echo organization_num_employees_ranges=201,500 (201-500), organization_locations=germany, organization_industry_tag_ids=5567cd4e7369643b70010000 (display_name 'computer software'); all three are documented params per the fetched organization-search reference. pagination shows page 1, per_page 10, total_entries 365, and exactly 10 organizations. Printed output matches the saved JSON exactly, including honestly printing '(not in response)' for industry/employees/country, which the search objects genuinely lack (verified by re-parsing the file). Apollo's taxonomy has no 'software development' value (run1 with that name returned 0 entries); the agent derived the equivalent 'computer software' tag id from the documented Organization Enrichment endpoint and documented the mapping. Supplementary documented bulk_enrich (not a post-filter) confirms all 10 are country=Germany, 240-480 employees, and carry the 'computer software' industry tag. No saved file, output or log contains the key (independent grep plus the agent's own scan).

Attempt record

  1. 0:34Answered from saved key: Apollo.io API keyno wait
  2. —First success verified

Attempt artifacts saved.