The Prompting Company

Benchmark report

Task verified

6m 12s elapsed

The saved attempt met the documented success criterion.

Experience score

99/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • SDocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs S, Current ASInstallSAuthSExecuteSDocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
One wasted delete attempt: docs advertise --yes but CLI 65.12.1 demanded --confirm-name; plus a ~7s alias propagation delay serving 200 after project deletion.

Where the time went

6:13 agent time
  • Research0:24
  • Attempt4:06
  • Verify1:43
6m 12sTotal elapsed
2:18Time to first success
0:00Waited on the owner

Judge reason

Saved evidence independently supports every criterion. code/tpcbench-20261106230020-c33c0971/api/index.js is a Node serverless function returning {marker, servedAt:new Date().toISOString()}, deployed via documented CLI (outputs/03-deploy.stdout.txt: Vercel CLI 65.12.1, `vercel deploy --prod`, readyState READY) to https://tpcbench-20261106230020-c33c0971.vercel.app (platform domain). Polling returned 200 on attempt 1 (outputs/04-poll.txt). Two fetches (outputs/05-fetch1/2 + headers, HTTP/2 200, server: Vercel, x-vercel-id differs) both carry marker tpcbench-marker-79ecda6517da005a249c3dca with servedAt 23:01:00.608Z vs 23:01:02.890Z, proving per-request computation. Account/team IDs resolved via GET /v2/user and /v2/teams (outputs/01,02). Cleanup: `vercel project rm ... --confirm-name` succeeded (outputs/08 '✓ Deleted'), REST /v10/projects list for team and personal scope shows zero tpcbench- projects (evidence/cleanup-evidence.txt), and the final fetch returns HTTP/2 404 x-vercel-error: DEPLOYMENT_NOT_FOUND (outputs/11-final.headers.txt) after a brief alias-propagation 200. Only one resource was created, named with the tpcbench- prefix. No token appears in any saved file or printed output; the token was passed via VERCEL_TOKEN from a file outside the home dir and command echoes show VERCEL_TOKEN=<redacted>.

Attempt record

  1. 0:57Answered from saved key: Vercel API tokenno wait
  2. —First success verified

Attempt artifacts saved.