Axis leaderboard / API and MCP / two boards
API and MCP
Full-stack app builders: ranked by api and mcp
Ordered by axis subscore, highest first, within this board's own cohort.
| #Tool | API and MCP | REST API | Webhooks | MCP server | Composite |
|---|---|---|---|---|---|
97.0 | Versioned REST with API keys | Outbound with HMAC signing and delivery history | Yes, verified by connecting a client | 89.48 | |
79.0 | Generated per function, no key manager by default | Outbound supported, signing written by hand | Yes | 80.92 | |
71.0 | Hand written, full control | Hand written, full control | Yes | 75.47 | |
66.0 | Generated per project, versioning is manual | Outbound supported, signing needs prompting | Yes, official connector | 80.54 | |
66.0 | Generated per entity | Inbound and outbound, no signing by default | Yes, vendor hosted, OAuth scoped to a workspace, Builder plan and above | 73.05 | |
62.0 | Generated with API keys | Outbound, unsigned by default | Yes | 65.59 | |
61.0 | Generated, conventions vary between runs | Generated on request | Yes | 68.68 | |
60.0 | Route handlers, no key management by default | Hand written, no built in delivery log | Yes | 78.31 | |
60.0 | Hand written | Hand written | Yes | 67.49 | |
58.0 | Hand written | Hand written | No first party server | 74.68 | |
58.0 | Route handlers, keys added on request | Outbound, unsigned by default | No | 69.48 | |
57.0 | Generated, unversioned | Outbound, signing on request | Yes | 69.97 | |
55.0 | Read and write, no key rotation | Outbound only, no retry ladder | Yes, vendor hosted remote server at mcp.floot.com, OAuth, listed in the Claude connector directory | 68.66 | |
52.0 | Generated, no key management | Outbound only, unsigned | No | 62.12 | |
52.0 | Gateway exposed | Outbound is constrained by the runtime | Yes, vendor hosted at mcp.caffeine.ai, OAuth sign in, published as alpha | 62.08 | |
48.0 | Hand written | Hand written | Community support | 59.85 | |
48.0 | Generated, minimal key handling | Inbound only | No | 56.99 | |
47.0 | Limited | Outbound only | Yes, vendor hosted at mcp.zite.com over streamable HTTP with OAuth, 17 build tools plus data tools | 61.06 | |
44.0 | Read mostly | Inbound only | No | 58.53 | |
41.0 | Read mostly | Inbound only | No | 58.11 |
Coding agents: ranked by api and mcp
Ordered by axis subscore, highest first, within this board's own cohort.
| #Tool | API and MCP | REST API | Webhooks | MCP server | Composite |
|---|---|---|---|---|---|
78.0 | Versioned when asked, documented as it goes | Signed with a retry ladder by default | Yes, client and server | 79.72 | |
76.0 | Versioned and documented | Signed with a delivery log | Yes | 71.48 | |
74.0 | Written to your conventions | Written properly when the criterion names signing | Yes, client and server | 77.92 | |
74.0 | Written to your existing conventions | Signed with a delivery log | Yes | 75.63 | |
72.0 | Written from the spec it produced | Signed, delivery log when asked | Yes | 75.67 | |
72.0 | Written to your conventions | Signed when the criterion names it | Yes | 73.35 | |
72.0 | Written and documented | Signed with a delivery log | Yes | 66.64 | |
70.0 | Written to your conventions | Signed when the criterion names it | Yes | 71.37 | |
70.0 | Written to your conventions | Signed when the criterion names it | Yes | 70.66 | |
68.0 | Written with contract tests | Written with tests around the signature | Yes | 66.06 | |
68.0 | Written to your conventions | Written, signing on request | Yes | 63.93 | |
66.0 | Written to your conventions | Written, signing on request | Yes | 71.13 | |
66.0 | Written to your conventions | Written, signing on request | Partial | 68.04 | |
64.0 | Written to your conventions | Written, signing on request | Yes | 64.51 | |
62.0 | Written to your conventions | Hand guided | Partial | 65.88 | |
62.0 | Written to your conventions | Written, signing on request | Yes | 59.89 | |
60.0 | Written to your conventions | Written, unsigned by default | Yes | 61.00 |
How the api and mcp axis is measured
Full-stack app builders. Scored against the prompt 4 and prompt 5 pass criteria with a fixed 22 point checklist covering versioning, error envelopes, idempotency keys, key revocation, HMAC signing, retry ladders and delivery history. MCP support is verified by connecting a client and listing tools.
Coding agents. Scored against the prompt 4 and prompt 5 pass criteria with a fixed 22 point checklist covering versioning, error envelopes, idempotency keys, key revocation, HMAC signing, retry ladders and delivery history. MCP support is verified by connecting a client and listing tools.
This axis carries 9 of the 100 index points on the builders board and 9.28 of the 100 index points on the coding agent board. Each product completed 5 runs of 9 prompts in this cycle, and the underlying per run data behind every figure on this page is downloadable at /api/runs.json under a CC BY 4.0 licence.
A high score on one axis is not a recommendation. Read it against the composite column on the right and against the axes that matter for the work you have in front of you. Reliability at 93.3% for the leader of the builders cohort is the context for everything else on the page.