CodexCompare companies
Select 2-4 rows to compare scores, discoverability, cost, errors, and eval details.
LightsageClickTap any row to explore the full eval.
Get your API graded →
| Rank | Tool | Score | Grade | Task | Eval | Discovery | Cost | Calls | Errors | Time | |
|---|---|---|---|---|---|---|---|---|---|---|---|
1🥇 | You.com | 86 | B | 80 | 100 | $0.51 | 6 | 0 | 1m 47s | View report | |
2🥈 | Exa | 81 | B | 80 | 86 | $0.55 | 6 | 0 | 1m 27s | View report | |
3🥉 | Render | 78 | B | 81 | 72 | $0.33 | 9 | 0 | 4m 42s | View report | |
3🥉 | Scrapfly | 78 | B | 83 | 67 | $0.48 | 4 | 0 | 5m 31s | View report | |
3🥉 | Extend.ai | 78 | B | 74 | 88 | $0.41 | 4 | 1 | 3m 50s | View report | |
6 | Reducto | 76 | B | 70 | 92 | $0.64 | 8 | 1 | 3m 48s | View report | |
7 | Tavily | 74 | C | 83 | 55 | $0.40 | 6 | 0 | 1m 53s | View report | |
8 | Box | 73 | C | 81 | 55 | $0.62 | 8 | 0 | 2m 8s | View report | |
8 | ElevenLabs | 73 | C | 70 | 83 | $0.47 | 9 | 2 | 3m 47s | View report | |
10 | Descope | 72 | C | 84 | 45 | $0.41 | 5 | 0 | 3m 29s | View report | |
10 | Stripe | 72 | C | 80 | 55 | $0.51 | 8 | 0 | 4m 3s | View report | |
12 | Agentmail | 71 | C | 66 | 83 | $0.82 | 13 | 3 | 3m 33s | View report | |
12 | Jina AI | 71 | C | 71 | 71 | $0.51 | 7 | 1 | 2m 41s | View report | |
12 | Composio | 71 | C | 79 | 55 | $0.95 | 8 | 0 | 4m 13s | View report | |
12 | Merge Agent Handler | 71 | C | 78 | 55 | $0.95 | 9 | 0 | 5m 13s | View report | |
16 | Qdrant | 69 | C | 62 | 88 | $1.26 | 25 | 11 | 7m 4s | View report | |
17 | Cartesia | 66 | C | 75 | 45 | $0.58 | 11 | 0 | 11m 9s | View report | |
17 | Telnyx | 66 | C | 75 | 45 | $0.97 | 17 | 0 | 4m 55s | View report | |
17 | PayPal | 66 | C | 80 | 34 | $0.69 | 10 | 0 | 3m 57s | View report | |
20 | fastCRW | 63 | C | 53 | 88 | $0.36 | 4 | 0 | 2m 53s | View report | |
21 | Firecrawl | 62 | C | 65 | 55 | $0.77 | 8 | 2 | 3m 47s | View report | |
21 | Clerk | 62 | C | 65 | 55 | $0.70 | 15 | 5 | 6m 8s | View report | |
21 | Pinecone | 62 | C | 46 | 100 | $0.74 | 7 | 0 | 2m 14s | View report | |
21 | TABStack | 62 | C | 59 | 69 | $1.72 | 12 | 3 | 5m 7s | View report | |
21 | Resend | 62 | C | 65 | 55 | $1.26 | 15 | 1 | 3m 18s | View report | |
26 | Twilio | 58 | C | 64 | 45 | $2.87 | 15 | 7 | 6m 47s | View report | |
26 | Razorpay | 58 | C | 60 | 55 | $4.82 | 49 | 13 | 12m 47s | View report | |
28 | MeetGeek | 54 | D | 39 | 90 | $0.24 | 5 | 2 | 3m 27s | View report | |
29 | Daytona | 52 | D | 52 | 55 | $0.21 | 4 | 0 | 2m 46s | View report | |
30 | E2B | 50 | D | 34 | 89 | $0.36 | 7 | 2 | 4m 33s | View report | |
31 | Chroma | 48 | D | 31 | 89 | $0.73 | 19 | 8 | 4m 49s | View report | |
31 | Datadog | 48 | D | 36 | 78 | $0.71 | 15 | 0 | 12m 21s | View report | |
33 | Prefect | 47 | D | 30 | 88 | $0.48 | 16 | 9 | 3m 51s | View report | |
34 | Nimble | 44 | D | 32 | 75 | $1.58 | 12 | 1 | 4m 36s | View report | |
35 | Massive | 41 | D | 24 | 82 | $1.84 | 19 | 8 | 5m 22s | View report | |
35 | Netlify | 41 | D | 27 | 74 | $1.27 | 29 | 15 | 6m 19s | View report | |
35 | Resemble AI | 41 | D | 29 | 68 | $0.71 | 12 | 6 | 3m 13s | View report | |
38 | Paddle | 39 | D | 25 | 71 | $1.33 | 11 | 2 | 7m 3s | View report | |
39 | Pipecat | 38 | D | 27 | 66 | $0.56 | 11 | 2 | 10m 44s | View report | |
40 | Recall.ai | 35 | D | 21 | 68 | $1.95 | 30 | 6 | 20m 34s | View report | |
41 | LiveKit | 34 | D | 32 | 40 | $0.44 | 8 | 1 | 5m 27s | View report | |
42 | Zilliz Cloud | 33 | D | 24 | 55 | $1.75 | 28 | 11 | 5m 24s | View report | |
43 | Nylas | 32 | D | 23 | 55 | $1.59 | 23 | 7 | 7m 21s | View report | |
44 | Auth0 | 31 | D | 26 | 44 | $5.04 | 53 | 15 | 16m 43s | View report | |
44 | Plivo | 31 | D | 26 | 45 | $1.95 | 28 | 12 | 5m 17s | View report | |
46 | Cerebras | 30 | D | 24 | 45 | $1.39 | 26 | 10 | 5m 20s | View report | |
46 | Scalekit | 30 | D | 23 | 48 | $1.14 | 20 | 1 | 20m 12s | View report | |
48 | Deepgram | 29 | D | 2 | 93 | $2.68 | 32 | 13 | 8m 38s | View report | |
49 | Groq | 25 | D | 3 | 79 | $3.47 | 43 | 16 | 10m 32s | View report | |
50 | Convex | 20 | D | 1 | 64 | $15.20 | 83 | 30 | 29m 24s | View report | |
51 | Meeting BaaS | 18 | D | 3 | 55 | $8.60 | 75 | 35 | 14m 50s | View report | |
52 | Cloudflare | 17 | D | 4 | 48 | $1.10 | 22 | 5 | 6m 44s | View report | |
53 | Naive | 15 | D | 2 | 45 | $1.69 | 29 | 6 | 9m 36s | View report | |
54 | LanceDB | 9 | D | 0 | 30 | $0.47 | 14 | 1 | 1m 51s | View report | |
55 | Weaviate Missing MCP auth env vars: WEAVIATE_URL, WEAVIATE_API_KEY | — | — | — | — | — | — | — | — | — | View report |
55 | Square Missing MCP auth env vars: ACCESS_TOKEN | — | — | — | — | — | — | — | — | — | View report |
57 | DigitalOcean Signup requires a credit card | — | — | — | — | — | — | — | — | — | View report |
57 | Perplexity API key requires a paid plan | — | — | — | — | — | — | — | — | — | View report |
57 | Adyen API key requires official certification | — | — | — | — | — | — | — | — | — | View report |
60 | Fireblocks Missing MCP auth env vars: FIREBLOCKS_API_KEY, FIREBLOCKS_PRIVATE_KEY_PATH, FIREBLOCKS_API_BASE_URL | — | — | — | — | — | — | — | — | — | View report |
60 | Sinch Missing MCP auth env vars: SINCH_APPLICATION_KEY, SINCH_APPLICATION_SECRET | — | — | — | — | — | — | — | — | — | View report |
60 | Coinbase Payments API Key could not be obtained | — | — | — | — | — | — | — | — | — | View report |
60 | BlindPay Missing MCP auth env vars: BLINDPAY_INSTANCE_ID | — | — | — | — | — | — | — | — | — | View report |
60 | Vonage Missing MCP auth env vars: VONAGE_APPLICATION_ID, VONAGE_PRIVATE_KEY | — | — | — | — | — | — | — | — | — | View report |
65 | Airwallex API key requires official certification | — | — | — | — | — | — | — | — | — | View report |
65 | Brave Search API key requires a paid plan | — | — | — | — | — | — | — | — | — | View report |
65 | Bandwidth No MCP server package available | — | — | — | — | — | — | — | — | — | View report |
65 | Netflix Conductor Open-source / self-hosted — no hosted API key available | — | — | — | — | — | — | — | — | — | View report |
65 | OpenCageData No MCP server package available | — | — | — | — | — | — | — | — | — | View report |
65 | Anchor Browser No MCP server package available | — | — | — | — | — | — | — | — | — | View report |
71 | Cloudflare Workers MCP server requires browser-based OAuth (cannot automate) | — | — | — | — | — | — | — | — | — | View report |
71 | Stytch MCP server requires browser-based OAuth (cannot automate) | — | — | — | — | — | — | — | — | — | View report |
71 | Vercel MCP server requires browser-based OAuth (cannot automate) | — | — | — | — | — | — | — | — | — | View report |
74 | TogetherAI API key requires a paid plan | — | — | — | — | — | — | — | — | — | View report |
75 | Railway MCP server requires browser-based OAuth (cannot automate) | — | — | — | — | — | — | — | — | — | View report |
76 | Infobip No MCP server package available | — | — | — | — | — | — | — | — | — | View report |
76 | Fireworks AI No MCP server package available | — | — | — | — | — | — | — | — | — | View report |
Scores calculated from end-to-end MCP evaluations by AI coding agents.
Frequently asked questions
Join the mailing list
Get updates on leaderboard changes, new benchmark releases, and product announcements.