Benchmark report
Task verified
5m 10s elapsed
The saved attempt met the documented success criterion.
96/ 100
Agent-Ready- SInstall
- SAuth
- SExecute
- ADocs
- SCurrent
Locating the current-employer-by-domain field (clay.filter_to_companies) required grepping the 173KB query reference returned by GET /search/query-mode/reference.
Where the time went
5:11 agent time- Research0:23
- Attempt2:47
- Verify2:01
Judge reason
Saved code clay/clay_people_search.py posts to the documented Clay Searches operation (POST https://api.clay.com/public/v0/search/query-mode to create search_0to0n62yYbX8JVeZ9n6, then two separate POSTs to /search/query-mode/{search_id}/run with {"limit":5}, auth via clay-api-key header read from a private file). run_output.txt (teed from one real run) shows create HTTP 200 and both pages HTTP 200 (code asserts st==200), 5 people each, has_more true, and 'overlapping ids between pages: none'. Saved page1/page2_response.redacted.json each hold exactly 5 records with disjoint clay_profile_ids ([802339914,233391835,418095447,183898033,783995594] vs [208176343,680862030,104635603,4217326,313606622]) and titles matching the printed table exactly; identifiers, titles, matched_experiences, has_more, source_type and period_quota are preserved while name/first_name/last_name/linkedin_url/location.name are '[redacted]'. My independent regex scan of every file in clay/ found zero email addresses, zero person names and no API key, bearer or access token; the only token-word hits are the redaction key list in the script and a REPORT.md sentence. Liveness is corroborated by period_quota.used rising 287858 -> 287863 between pages and by the 180707-byte reference.json fetched from GET /search/query-mode/reference (HTTP 200). The API reports no page number/cursor or total count; the agent printed has_more and explicitly stated the total is not reported, consistent with the docs it cited (developers.clay.com/searches/advanced, which states count queries are unavailable via the Public API). No mocking or hard-coded data.
Attempt record
- 0:48Answered from saved key: Clay Public API keyno wait
- —First success verified
Attempt artifacts saved.