Devtool Arena

Benchmarking developer tools evaluated by Codex Codex across auth, inference, voice, and more.

API CLI MCP

Search a tool (e.g. Stripe, Chroma)

Compare companies

Select 2-4 rows to compare scores, discoverability, cost, errors, and eval details.

Show companies whose evals were skipped (e.g. no API key provided)

Last updated Sep 7Last updated September 7, 2026 at 3:02 PM UTC

Lightsage

ClickTap any row to explore the full eval.
Get your API graded →

Rank	Tool	Score	Grade	Eval	Discovery	Cost	Calls	Errors	Time
1🥇	Stripe	88	B	84	100	$0.28	7	1	55s	View report
1🥇	Box	88	B	83	100	$0.33	10	0	1m 10s	View report
3🥉	Fireworks AI	87	B	82	100	$0.45	9	0	1m 45s	View report
4	Datadog	84	B	78	100	$0.29	9	1	1m 28s	View report
5	ElevenLabs	82	B	75	100	$1.05	21	0	1m 26s	View report
5	Neo4j	82	B	81	86	$0.38	13	0	1m 20s	View report
7	WorkOS	81	B	73	100	$0.78	16	0	2m 29s	View report
7	OpenCageData	81	B	79	86	$0.28	6	0	58s	View report
7	Browserbase	81	B	73	100	$0.57	18	1	1m 5s	View report
10	OpenRouter	79	B	77	86	$0.29	5	0	1m 43s	View report
10	ElevenLabs Music	79	B	70	100	$1.04	22	2	1m 43s	View report
10	Steel	79	B	71	100	$1.01	18	2	1m 30s	View report
13	LiveKit	78	B	82	71	$0.60	10	0	1m 44s	View report
13	Prefect	78	B	69	100	$0.75	11	3	2m 41s	View report
13	Resemble AI	78	B	75	86	$0.54	12	0	2m 14s	View report
13	E2B	78	B	82	71	$0.40	7	0	1m 3s	View report
17	Docusign	76	B	79	71	$0.53	14	0	1m 35s	View report
17	Diffbot	76	B	72	86	$0.98	16	2	1m 44s	View report
17	You.com	76	B	66	100	$4.56	23	2	2m 24s	View report
17	Reducto	76	B	66	100	$1.13	21	3	2m 40s	View report
21	Mollie	75	B	83	57	$0.35	9	0	1m 32s	View report
21	Temporal	75	B	77	71	$0.53	10	1	1m 48s	View report
21	Groq	75	B	83	57	$0.24	6	0	1m 33s	View report
21	SambaNova	75	B	83	57	$0.36	10	0	1m 26s	View report
21	Twilio	75	B	65	100	$1.18	16	5	3m 51s	View report
21	Merge Gateway	75	B	65	100	$2.55	27	6	2m 49s	View report
21	Browser Use	75	B	65	100	$1.27	30	4	2m 23s	View report
28	Apideck	74	C	63	100	$2.69	20	5	5m 2s	View report
28	Scalekit	74	C	64	100	$2.55	25	3	3m 37s	View report
28	Dropbox	74	C	76	71	$0.38	13	2	1m 22s	View report
28	Rime	74	C	88	43	$0.42	9	0	56s	View report
28	Pinecone	74	C	64	100	$1.81	22	5	3m 39s	View report
28	Telnyx	74	C	64	100	$3.50	22	5	4m 34s	View report
28	Resend	74	C	64	100	$1.46	21	7	4m 2s	View report
28	Nimble	74	C	64	100	$1.94	25	1	3m 21s	View report
28	Merge	74	C	63	100	$2.72	36	5	4m 6s	View report
28	Superserve	74	C	69	86	$1.36	31	6	1m 47s	View report
28	Modal	74	C	76	71	$0.86	9	1	1m 58s	View report
28	Blaxel	74	C	63	100	$5.17	48	25	4m 35s	View report
28	fastCRW	74	C	69	86	$1.08	26	4	1m 40s	View report
28	Zep	74	C	63	100	$3.43	32	10	4m 19s	View report
28	Replicate	74	C	63	100	$1.88	31	8	3m 20s	View report
43	Pipecat	72	C	61	100	$3.78	34	15	6m 39s	View report
43	Render	72	C	61	100	$2.71	29	3	6m 9s	View report
43	Zilliz Cloud	72	C	66	86	$1.13	13	1	4m 3s	View report
43	Firecrawl	72	C	67	86	$1.22	18	2	2m 5s	View report
43	Vapi	72	C	60	100	$6.50	43	10	13m 9s	View report
43	Chroma	72	C	67	86	$1.43	17	1	2m 40s	View report
43	Convex	72	C	66	86	$0.85	19	3	3m 8s	View report
43	Extend.ai	72	C	66	86	$1.45	21	3	2m 11s	View report
51	Pioneer AI	71	C	71	71	$1.02	18	1	1m 52s	View report
51	LMNT	71	C	83	43	$0.31	6	0	1m 10s	View report
51	Tavily	71	C	65	86	$1.62	20	4	3m 15s	View report
51	Anchor Browser	71	C	65	86	$1.39	26	5	2m 36s	View report
51	Daytona	71	C	65	86	$1.19	16	1	3m 48s	View report
56	Chargebee	70	C	64	86	$2.24	24	3	4m 6s	View report
56	Razorpay	70	C	70	71	$0.63	11	1	2m 50s	View report
56	PandaDoc	70	C	64	86	$1.38	24	2	3m 31s	View report
56	TinyFish	70	C	64	86	$3.67	25	5	4m 4s	View report
56	AIsa	70	C	70	71	$1.35	23	1	1m 51s	View report
61	Agentmail	69	C	63	86	$1.98	29	8	3m 45s	View report
61	Qdrant	69	C	62	86	$1.46	21	2	5m 28s	View report
61	Nylas	69	C	63	86	$4.79	42	13	4m 57s	View report
64	Apollo	68	C	68	71	$3.73	32	0	3m 29s	View report
64	Cerebras	68	C	68	71	$0.78	16	2	2m 53s	View report
64	Agora	68	C	61	86	$4.59	42	10	6m 35s	View report
64	Jina AI	68	C	61	86	$3.09	33	3	5m 2s	View report
64	Restate	68	C	61	86	$3.89	43	13	5m 51s	View report
64	Sonilo	68	C	68	71	$0.98	17	2	2m 32s	View report
64	LlamaParse	68	C	67	71	$1.25	17	7	2m 36s	View report
64	Relevance AI	68	C	61	86	$5.61	37	3	8m 8s	View report
64	Mem0	68	C	61	86	$1.96	27	3	5m 18s	View report
73	Postman	67	C	72	57	$0.78	17	2	1m 45s	View report
73	Cognee	67	C	60	86	$12.09	55	21	13m 40s	View report
73	CopilotKit	67	C	66	71	$1.56	24	6	2m 23s	View report
76	PayPal	66	C	65	71	$2.26	30	4	2m 12s	View report
76	Exa	66	C	65	71	$1.51	27	3	2m 51s	View report
76	Speechify	66	C	71	57	$0.95	21	1	1m 34s	View report
79	Tavus	65	C	75	43	$1.56	15	4	5m 58s	View report
79	Nebius AI Cloud	65	C	63	71	$3.02	40	5	4m 1s	View report
79	Auth0	65	C	63	71	$2.04	29	5	4m 16s	View report
79	Cartesia	65	C	69	57	$1.66	33	2	1m 59s	View report
79	Massive	65	C	63	71	$1.77	49	9	4m 35s	View report
79	TABStack	65	C	63	71	$1.89	29	10	4m 8s	View report
79	FalkorDB	65	C	63	71	$3.04	39	8	3m 48s	View report
79	Tenki	65	C	63	71	$3.40	29	10	4m 33s	View report
79	Letta	65	C	63	71	$4.73	36	5	4m 46s	View report
88	Clerk	64	C	67	57	$1.00	18	3	2m 6s	View report
88	Stytch	64	C	61	71	$4.09	38	8	6m 51s	View report
90	HeyGen	63	C	65	57	$2.45	20	16	4m 28s	View report
90	Recall.ai	63	C	78	29	$0.56	8	0	2m 50s	View report
90	Freestyle	63	C	60	71	$8.91	41	15	11m 1s	View report
90	Memgraph	63	C	66	57	$1.31	23	3	2m 54s	View report
90	Ravion	63	C	60	71	$11.83	53	4	13m 28s	View report
95	Deepgram	62	C	47	100	$0.44	8	0	1m 7s	View report
95	Surge	62	C	71	43	$1.15	18	5	1m 46s	View report
97	Mesh API	61	C	63	57	$1.89	27	5	3m 59s	View report
97	Descope	61	C	64	57	$1.22	22	5	3m 5s	View report
97	BoldSign	61	C	69	43	$2.61	26	3	1m 55s	View report
97	HitPay	61	C	63	57	$4.06	32	6	4m 27s	View report
97	Stability AI	61	C	70	43	$2.43	29	0	2m 1s	View report
102	Meetstream	60	C	62	57	$1.50	22	4	5m 44s	View report
103	LanceDB	59	C	55	71	$1.01	16	1	4m 3s	View report
103	Infobip	59	C	61	57	$4.66	41	10	8m 5s	View report
103	Daily	59	C	61	57	$3.05	39	11	6m 25s	View report
106	Meeting BaaS	58	C	65	43	$1.95	18	5	4m 48s	View report
106	Prelude	58	C	65	43	$1.34	29	7	2m 22s	View report
106	BetterStack	58	C	65	43	$1.17	19	1	4m 7s	View report
109	Scrapfly	57	C	39	100	$0.61	14	1	1m 25s	View report
109	Google DeepMind	57	C	69	29	$0.99	13	1	2m 44s	View report
111	AssemblyAI	56	C	38	100	$0.70	14	1	1m 48s	View report
111	Plivo	56	C	63	43	$2.35	35	6	4m 31s	View report
111	Kite	56	C	63	43	$3.71	41	8	3m 6s	View report
114	MeetGeek	54	D	65	29	$1.36	18	8	4m 30s	View report
114	LemonSqueezy	54	D	65	29	$1.02	18	1	4m 47s	View report
116	Allo	52	D	63	29	$6.54	48	11	4m 37s	View report
117	Circle	49	D	28	100	$2.64	36	9	4m 1s	View report
118	Unstructured	48	D	33	86	$0.51	13	1	3m 3s	View report
119	Paddle	46	D	29	86	$1.46	24	8	3m 7s	View report
119	Naive	46	D	36	71	$2.05	19	4	1m 43s	View report
121	BlindPay	44	D	26	86	$5.26	53	14	9m 13s	View report
121	Vercel	44	D	26	86	$2.11	35	13	5m 45s	View report
123	Nebius Token Factory	43	D	43	43	$0.36	6	2	1m 34s	View report
123	Upsun	43	D	25	86	$7.11	40	5	10m 47s	View report
125	Bolna	42	D	30	71	$2.94	29	3	2m 28s	View report
125	Zoom AI Services	42	D	30	71	$1.98	41	6	2m 57s	View report
127	Coinbase Payments	40	D	28	71	$4.53	34	9	4m 25s	View report
128	DFNS	39	D	32	57	$1.74	19	4	2m 55s	View report
128	Railway	39	D	26	71	$2.83	26	7	5m 59s	View report
130	Dust	38	D	30	57	$3.61	40	3	2m 58s	View report
130	Gumloop	38	D	30	57	$2.83	34	11	2m 50s	View report
132	Loudly	33	D	30	43	$3.64	37	10	2m 21s	View report
133	Mubert	32	D	28	43	$2.95	35	5	3m 10s	View report
133	Sensible	32	D	28	43	$2.75	42	6	4m 14s	View report
133	TigerGraph	32	D	28	43	$1.87	33	9	3m 22s	View report
133	Google Lyria	32	D	28	43	$2.30	28	8	4m 49s	View report
137	Rev AI	31	D	32	29	$0.75	11	2	3m 41s	View report
137	Pursuit	31	D	26	43	$2.50	39	13	5m 6s	View report
139	NationGraph	30	D	31	29	$1.56	25	3	2m 59s	View report
140	GovSpend	24	D	29	14	$1.02	23	2	3m 0s	View report
141	Netlify Could not obtain API key	—	—	—	—	—	—	—	—	View report
141	Camunda Could not obtain API key	—	—	—	—	—	—	—	—	View report
143	Fireblocks Could not obtain API key	—	—	—	—	—	—	—	—	View report
143	Weaviate Could not obtain API key	—	—	—	—	—	—	—	—	View report
143	Cloudflare Workers Could not obtain API key	—	—	—	—	—	—	—	—	View report
143	Strapi Could not obtain API key	—	—	—	—	—	—	—	—	View report
143	Akka Could not obtain API key	—	—	—	—	—	—	—	—	View report
143	TogetherAI API key requires a paid plan	—	—	—	—	—	—	—	—	View report
143	DigitalOcean Signup requires a credit card	—	—	—	—	—	—	—	—	View report
143	Netflix Conductor Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report
143	OpenAI Whisper API key requires a paid plan	—	—	—	—	—	—	—	—	View report
143	Ash Could not obtain API key	—	—	—	—	—	—	—	—	View report
143	Vonage Could not obtain API key	—	—	—	—	—	—	—	—	View report
154	Bandwidth Could not obtain API key	—	—	—	—	—	—	—	—	View report
154	DeepInfra API key requires a paid plan	—	—	—	—	—	—	—	—	View report
154	Perplexity API key requires a paid plan	—	—	—	—	—	—	—	—	View report
154	Adyen API key requires official certification or company verification	—	—	—	—	—	—	—	—	View report
154	Sprites Could not obtain API key	—	—	—	—	—	—	—	—	View report
159	Speechmatics API key requires a paid plan	—	—	—	—	—	—	—	—	View report
159	AWS Step Functions Could not obtain API key	—	—	—	—	—	—	—	—	View report
159	Airwallex API key requires official certification or company verification	—	—	—	—	—	—	—	—	View report
159	Sinch Could not obtain API key	—	—	—	—	—	—	—	—	View report
159	Cadence Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report
159	Macroscope Could not obtain API key	—	—	—	—	—	—	—	—	View report
165	Brave Search API key requires a paid plan	—	—	—	—	—	—	—	—	View report
165	100ms API key requires a paid plan	—	—	—	—	—	—	—	—	View report
165	Square Could not obtain API key	—	—	—	—	—	—	—	—	View report
165	Roster No API key configured for this company	—	—	—	—	—	—	—	—	View report
169	Triple-A Could not obtain API key	—	—	—	—	—	—	—	—	View report
169	CueMeet Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report