Loading benchmark results... 01 Open-Meteo Weather API open-meteo.com 100% passed Open-Meteo agent profile: Install S, Auth S, Execute S, Docs S, Current S 100 Agent-Ready — 02 context.dev Search context.dev 100% passed context.dev agent profile: Install S, Auth S, Execute S, Docs S, Current S 100 Agent-Ready — 03 Firecrawl Search firecrawl.dev 100% passed Firecrawl agent profile: Install S, Auth S, Execute S, Docs S, Current S 100 Agent-Ready — 04 Pydantic Validation Data validation pydantic.dev/docs/validation/latest/get-started 100% passed Pydantic Validation agent profile: Install S, Auth S, Execute S, Docs S, Current S 100 Agent-Ready — 05 Parallel Search parallel.ai 75% passed · 1 blocked 75% 3 of 4 passed · 1 blocked
Parallel agent profile: Install S, Auth S, Execute S, Docs S, Current S 100 Agent-Ready — 06 tinyfish.ai Browser Automation tinyfish.ai 67% passed · 1 blocked 67% 2 of 3 passed · 1 blocked
tinyfish.ai agent profile: Install S, Auth S, Execute S, Docs S, Current S 100 Agent-Ready — 07 duckdb.org Embedded analytical database duckdb.org/docs/current 100% passed duckdb.org agent profile: Install A, Auth S, Execute S, Docs S, Current S 98 Agent-Ready — 08 Polars DataFrame library docs.pola.rs/user-guide/getting-started 100% passed Polars agent profile: Install A, Auth S, Execute S, Docs S, Current S 98 Agent-Ready — 09 Exa Search exa.ai 89% passed · 1 blocked 89% 8 of 9 passed · 1 blocked
Exa agent profile: Install S, Auth A, Execute A, Docs S, Current S 84 Needs Alignment — 10 Resend Email resend.com 0% passed · 1 blocked 0% 0 of 1 passed · 1 blocked
Resend agent profile: Install A, Auth A, Execute B, Docs S, Current S 70 Needs Alignment — 11 Tavily Search docs.tavily.com/documentation/quickstart 17% passed · 5 blocked 17% 1 of 6 passed · 5 blocked
Tavily agent profile: Install A, Auth A, Execute C, Docs S, Current S 56 Critical Gating — 12 Stripe Payments stripe.com 0% passed · 2 blocked 0% 0 of 2 passed · 2 blocked
Stripe agent profile: Install S, Auth C, Execute D, Docs S, Current S 38 Critical Gating — 13 monday.com Work management API monday.com 0% passed · 2 blocked 0% 0 of 2 passed · 2 blocked
monday.com agent profile: Install S, Auth C, Execute D, Docs A, Current S 29 Critical Gating — 14 struct.ai AI production monitoring struct.ai 0% passed · 1 blocked 0% 0 of 1 passed · 1 blocked
struct.ai agent profile: Install D, Auth C, Execute D, Docs S, Current A 26 Critical Gating — 15 apollo.io Sales intelligence apollo.io 0% passed · 2 blocked 0% 0 of 2 passed · 2 blocked
Not graded — 16 AI SDK AI SDK ai-sdk.dev 0% passed · 1 blocked 0% 0 of 1 passed · 1 blocked
Not graded — 17 tinyfish.com Browser Automation tinyfish.com 0% passed · 1 blocked 0% 0 of 1 passed · 1 blocked
Not graded — 