Benchmark report

Task verified

8m 17s elapsed

The saved attempt met the documented success criterion.

Experience score

95/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current ASInstallSAuthSExecuteADocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
Undocumented response richness (nested contributors, bios, prose names) forced two redaction rewrites and three re-runs after the API calls already succeeded.

Where the time went

8:18 agent time
  • Research0:27
  • Attempt4:56
  • Verify2:54
8m 17sTotal elapsed
0:57Time to first success
0:00Waited on the owner

Judge reason

Saved people_search.py POSTs to the documented https://api.richapi.ai/api/v1/people_search with x-api-key, body {"job_title":["Software Engineer"],"domain":["stripe.com"],"limit":5,"page":0|1} as two separate calls. run_output.txt shows HTTP 200 twice; saved responses carry distinct request_ids (req-e13038c8..., req-4b5267f2...), pageable offset 0 then 5, pageNumber 0/1, size 5, numberOfElements 5, totalElements 3093, and a credit balance decrementing 5055.45 -> 5054.95, proving two real live calls. I re-checked the artifacts: 5 people per page, zero id overlap, and printed ids/titles/counts match page0/page1_response.redacted.json exactly. firstname/lastname/middleName and nested contributors firstName/lastName are "[redacted]" in both files; no email address matches anywhere; remaining name-like strings are only the LinkedIn url/identifier/profileId slugs the criteria require keeping (the plan designates url as the person id). No saved file contains a key or token value - only header names like x-api-key:. Minor over-redaction of bio prose (e.g. "Ministry of [redacted]") alters some free text beyond names, but identifiers, titles, pagination fields and counts are intact, so every success criterion holds.

Attempt record

  1. 0:57Answered from saved key: RichAPI API keyno wait
  2. —First success verified

Attempt artifacts saved.