Benchmark report

Task verified

6m 12s elapsed

The saved attempt met the documented success criterion.

Experience score

89/ 100

Agent-Ready
  • SInstall
  • SAuth
  • AExecute
  • SDocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute A, Docs S, Current ASInstallSAuthAExecuteSDocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
Undocumented LMX variable-prefix rule caused a 422 on template creation, forcing a doc hunt (llms.txt, lmx.md) and leaving an undeletable orphan template.

Where the time went

6:13 agent time
  • Starting0:01
  • Research0:18
  • Attempt4:26
  • Verify1:28
6m 12sTotal elapsed
3:07Time to first success
0:00Waited on the owner

Judge reason

Saved code loops-task/send.js POSTs https://app.loops.so/api/v1/transactional with Bearer auth (key from benchmark-request, validated by GET /v1/api-key -> 200 {"success":true,"teamName":"Prompting Co"}). Evidence 05_send_request.json matches the code byte-for-byte (email test@example.com, transactionalId cmvh3vft100vt0jx5zb251rx0, addToAudience false, dataVariables customerName/orderNumber); 06_send_response.json shows a live 200 OK with Cloudflare cf-ray a4da9945cfc3f8cb-PDX, date Tue, 20 Oct 2026 19:58:41 GMT, x-ratelimit-remaining 9 and rawBody {"success":true} - the documented shape. Transcript line 143 shows the real run printing 'HTTP status: 200 OK' and 'Message identifier: none', matching 07_send_stdout.txt; Loops' docs and OpenAPI confirm the 200 body carries no id, so stating none is correct. Template subject 'Your Loops API test receipt' and plain-text LMX body with {data.customerName}/{data.orderNumber} were created and published through the API (01-04 evidence) and the registered dataVariables match the send payload. Sender was discovered via GET /v1/transactional -> /v1/transactional-emails/{id} -> /v1/email-messages/{id} (fromName 'Prompting Co', fromEmail local part 'rick' on the team's verified domain). Exactly one send: GET metrics returned {"sends":1,...}. Loops documents no test recipient and the benchmark information request for one returned outcome 'skipped', so the agent used test@example.com, the recipient Loops' own OpenAPI examples use and an RFC 2606 reserved domain no real mailbox can receive. Nothing mocked or hard-coded; REST API used, not SMTP or dashboard.

Attempt record

  1. 1:05Requested Test recipient email addressdeclined automatically: campaigns don't wait for people
  2. —First success verified

Attempt artifacts saved.