What MCP is
The Model Context Protocol (MCP) is an open standard for connecting AI systems to external data sources and capabilities. It was developed by Anthropic and is supported across Claude Code, and increasingly across other coding agents in the ecosystem. When you build an MCP server for your API, coding agents can:- Discover that your API is available as a direct integration
- Call your endpoints through a standardized protocol, not by generating raw HTTP code
- Verify that responses are correct before completing a recommendation
The MCP server registry has over 85,000 stars on GitHub and is the primary directory for discoverable MCP integrations. Publishing your server there is the most important step for ecosystem discoverability.
How MCP changes agent recommendations
The difference in agent behavior is significant. Consider a developer asking Claude Code to “create a new project in Linear”: Without MCP: The agent generates code that calls the Linear API, returns it to the developer, and the developer must run it manually. If the code has a bug, the developer debugs it. The agent never confirms the task succeeded. With MCP: Claude Code recognizes that Linear has an MCP server, connects to it directly, executes the action, and confirms the project was created — all within the conversation. The developer sees a result, not a code snippet to run later. That experience difference directly impacts recommendation rates. In Lightsage’s testing of 70+ APIs, MCP presence correlated strongly with higher usability scores and lower task abandonment rates. The agents that could verify success through MCP were far more likely to commit to a recommendation.The recommendation flow with MCP
The recommendation flow without MCP
How Lightsage evaluates your MCP server
The Devtool Arena leaderboard includes a dedicated MCP track. Lightsage evaluates MCP servers across three scores:Eval score
End-to-end task success rate. Given a real developer task, does the agent complete it using your MCP server? Measured across multiple task types and agent harnesses.
Discovery score
How easily can agents find your MCP server? Factors include presence in the MCP registry, documentation quality, and whether your server appears in agent context when relevant prompts are run.
Task success rate
Percentage of individual tool calls that complete without error. Broken down by tool and by error type, so you can see exactly which parts of your MCP server are underperforming.
Best practices for a high-scoring MCP server
Most MCP servers in the registry are minimally functional. The ones that dominate their categories share a set of consistent design patterns.Clear tool descriptions
Every tool in your MCP server requires a description that the agent uses to decide when to call it. Vague descriptions lead to wrong tool selection; wrong tool selection leads to failed tasks and low eval scores. Weak description:Consistent auth patterns
Your MCP server should accept authentication in the standard way for your ecosystem. For most APIs, that means a Bearer token passed via an environment variable during server initialization — not per-request, not through a custom header scheme that agents won’t know to use. Document the exact environment variable name and format in your MCP server README. If you useACME_API_KEY, say so explicitly. If the key format is sk_live_xxx, include that.
Descriptive error messages
Error handling inside your MCP server is as important as error handling in your REST API. When a tool call fails, return an error object that tells the agent what went wrong and what to do next.Comprehensive endpoint coverage
Your MCP server should cover your API’s primary use cases end-to-end. A server that only exposes two or three endpoints forces the agent to fall back to raw API calls for everything else, which eliminates the reliability advantage MCP provides. Prioritize the endpoints that appear most frequently in developer tasks:- Core create/read/update/delete operations for your primary resource
- Authentication and setup flows
- The endpoints referenced in your quick start documentation
- Webhook registration if your API is event-driven
How to register your MCP server
1
Build and test locally
Implement your MCP server following the MCP specification. Test each tool against Claude Code locally before publishing. Run the same prompts you use in Lightsage prompt tracking to validate end-to-end task completion.
2
Publish to the MCP registry
Submit a pull request to the modelcontextprotocol/servers repository. Follow their contribution guidelines for adding your server to the official registry. This is the primary discovery path for the Claude Code ecosystem.
3
Document for agent consumption
Write your MCP server README with agents as the primary audience. Include the exact environment variables required, the format of each one, installation instructions (typically
npx or uvx), and a list of available tools with their descriptions.4
Link from your llms.txt
Update your
yourdomain.com/llms.txt to reference your MCP server. Agents that read your llms.txt will then know an MCP integration is available before they search the registry.5
Submit to Devtool Arena
To get your MCP server benchmarked and listed on the Devtool Arena MCP leaderboard, submit your server details at lightsage.com/welcome. Lightsage runs your server through a standardized eval harness using Claude Code and reports eval score, discovery score, and task success rate.
MCP category leaders by use case
Based on Lightsage’s benchmarks across 70+ APIs, these MCP servers have the highest eval scores in their categories:
The pattern across all category leaders: their MCP servers have clear tool descriptions, consistent auth, descriptive errors, and broad endpoint coverage of their primary workflows.
Common MCP server pitfalls
Exposing too few tools
Exposing too few tools
A server with two or three tools forces agents to fall back to raw HTTP calls for everything else. Cover your primary workflows completely. If an agent must exit MCP mid-task, the reliability advantage disappears.
Vague tool descriptions
Vague tool descriptions
The tool description is the primary signal an agent uses to select the right tool. If the description could apply to multiple tools or doesn’t specify inputs and outputs, the agent will make wrong selections and fail tasks.
Silent failures
Silent failures
Returning an empty success response when something goes wrong is worse than returning a clear error. Agents interpret empty success as task completion and move on — leaving the developer with a broken state and no indication of what happened.
Not testing against multiple agents
Not testing against multiple agents
Claude Code and Codex have different tool selection behaviors. A server that works perfectly with Claude Code may fail with Codex if the tool descriptions use Claude-specific conventions. Test against both before publishing.
Skipping the registry
Skipping the registry
Publishing an MCP server on your own docs without submitting to the official registry means agents that search the registry for your category will not find you. Registry presence is the primary discovery mechanism.
Measuring MCP impact in Lightsage
After publishing your MCP server, track the following metrics in your Lightsage dashboard:- Tool call success rate — should increase as agents use MCP calls instead of raw API calls
- Error recovery rate — should increase with better error messages from your MCP server
- Completion rate — should increase as agents can verify task success directly
- MCP eval score — your Devtool Arena MCP leaderboard position, tracked over time
Related guides
- Add llms.txt to improve coding agent discoverability — the prerequisite Layer 3 step before MCP
- Optimize your API for AI coding agent discovery — full 4-layer optimization framework
- How to track coding agent recommendations for your API — measure MCP impact on your metrics