Benchmark report

Task verified

6m 30s elapsed

The saved attempt met the documented success criterion.

Experience score

95/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current ASInstallSAuthSExecuteADocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
Apollo publishes no list of industry names, so the agent had to probe enrichment endpoints to learn that 'Software Development' is 'computer software'.

Where the time went

6:30 agent time
  • Research0:22
  • Attempt3:56
  • Verify2:12
6m 30sTotal elapsed
1:46Time to first success
0:00Waited on the owner

Judge reason

Saved code code/apollo_company_search.py (and .sh equivalent) calls the documented Apollo Organization Search operation POST https://api.apollo.io/api/v1/mixed_companies/search with x-api-key auth and server-side filters organization_industries[]=computer software, organization_locations[]=germany, organization_num_employees_ranges[]=201,500, page=1, per_page=10. Saved output outputs_organization_search.txt shows HTTP status 200; responses/organization_search_page1.json is a live Apollo-shaped body with pagination {page 1, per_page 10, total_entries 365, total_pages 37}, breadcrumbs for the employee and location filters, and exactly 10 organizations. Filtering is server-side, not post-filtered: controls A/B/C/E show germany=881,397, germany+size=3,636, germany+size+computer software=365, and control D using organization_industry_tag_ids[]=5567cd4e7369643b70010000 returns the identical 365 (industry breadcrumb present). The search objects genuinely lack industry/employee/country fields, so the printed '(not in response)' is correct per 'where the response has them'; supplementary documented bulk_enrich (HTTP 200, responses/verification_bulk_enrich.json) shows all 10 are country Germany, 201-500 employees, with 'computer software' in industries. Printed names/domains match the saved JSON exactly (AvenDATA/avendata.com ... ClimatePartner/climatepartner.com). Control F documents that the literal name 'software development' returns total_entries 0, justifying Apollo's taxonomy name 'computer software'. No artifact contains an API key, access token or bearer token (grep over all files found only redaction-key literals and prose); the key was obtained via benchmark-request and read from a file outside the home directory.

Attempt record

  1. 1:19Answered from saved key: Apollo.io API keyno wait
  2. —First success verified

Attempt artifacts saved.