Benchmark report

Task verified

8m 2s elapsed

The saved attempt met the documented success criterion.

Experience score

100/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current SSInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
Nothing material: docs read, key request, and the live call completed in sequence with first success recorded at 52s elapsed.

Where the time went

8:03 agent time
  • Starting0:03
  • Research0:32
  • Attempt6:03
  • Verify1:25
8m 2sTotal elapsed
0:52Time to first success
0:00Waited on the owner

Judge reason

Saved code tinyfish-search/search_domains.py issues a real GET to https://api.search.tinyfish.ai with X-API-Key, params query='MVCC vacuum', include_domains=postgresql.org, exclude_domains=wiki.postgresql.org (request.json full_url matches, no site: operators or domain words in query). run_stdout.txt shows HTTP 200, total_results=10, and prints title+URL for all 10 results; response.json holds the unmodified body with documented fields (position, site_name, snippet, title, url). Independent recheck of response.json: all 10 hosts are www.postgresql.org (a postgresql.org subdomain), none is wiki.postgresql.org, >=3 results, and the script applies no local filtering (it prints every result returned). Fetched reference docs confirm include_domains/exclude_domains are documented GA parameters, not beta/preview/gated.

Attempt record

  1. 3:36Answered from saved key: TinyFish Search API key (TINYFISH_API_KEY)no wait
  2. —First success verified

Attempt artifacts saved.