The Prompting Company

Benchmark report

Task verified

10m 30s elapsed

The saved attempt met the documented success criterion.

Experience score

95/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current ASInstallSAuthSExecuteADocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
New site inherited the team default login protection, returning 401 for ~48 polls (~2.5 min) until the agent found the undocumented sso_login API field.

Where the time went

10:31 agent time
  • Research0:18
  • Attempt7:44
  • Verify2:29
10m 30sTotal elapsed
5:48Time to first success
0:00Waited on the owner

Judge reason

Saved artifacts prove the full task via Netlify's documented REST API (no CLI login, no dashboard). code/functions-src/tpcbench-endpoint.js computes servedAt with new Date().toISOString() per request; commands/commands.sh shows POST /api/v1/rick-chen/sites (account slug resolved via GET /api/v1/accounts), POST /sites/{id}/deploys file-digest, PUT file and function uploads, deploy state 'ready' (evidence/06, deploy_source 'api', function tpcbench-endpoint present). Site name tpcbench-88656b0b on https://tpcbench-88656b0b.netlify.app/ (platform domain). evidence/10-poll-until-200.log ends HTTP 200; fetch1 and fetch2 (evidence/11,12 with Server: Netlify headers) both carry marker tpcbench-marker-855f1f7a5d706369 with distinct servedAt 22:45:20.590Z vs 22:45:22.753Z. Cleanup: DELETE site, GET site -> {"code":404}, sites list after cleanup [], final fetch HTTP/2 404 Netlify not-found page with no marker. A new-site inherited sso_login=true caused 401s; the agent PATCHed only its own site and evidence/09-accounts-after.json shows the team default site_sso_login still true. No bearer/access token appears in any saved file or transcript output (token kept in /tmp/private/netlify.curlrc outside home).

Attempt record

  1. 0:51Answered from saved key: Netlify personal access tokenno wait
  2. —First success verified

Attempt artifacts saved.