Reader profile
Jide Okonkwo
Axis scores
70
Lab notes
1
Comments
2
Upvotes received
5
Axis scores
Reader scores feed the reader index column. The measured lab index is never affected by them.
| Product | Axes scored | Mean | Last change |
|---|---|---|---|
| Augment Code | Agent performance 77, Reliability 80, Scalability 74, SEO and GEO 48, API and MCP 74, Integrations 69, Design output 62, Turn latency score 35, Value 51, Code ownership 98 | 66.8 | 28 Aug 2026 Lab seeded |
| Factory | Agent performance 82, Reliability 79, Scalability 74, SEO and GEO 46, API and MCP 77, Integrations 69, Design output 49, Turn latency score 10, Value 42, Code ownership 94 | 62.2 | 28 Aug 2026 Lab seeded |
| Qodo | Agent performance 61, Reliability 80, Scalability 71, SEO and GEO 42, API and MCP 57, Integrations 61, Design output 52, Turn latency score 25, Value 69, Code ownership 93 | 61.1 | 28 Aug 2026 Lab seeded |
| Cursor | Agent performance 100, Reliability 91, Scalability 92, SEO and GEO 67, API and MCP 76, Integrations 89, Design output 68, Turn latency score 63, Value 82, Code ownership 100 | 82.8 | 28 Aug 2026 Lab seeded |
| Claude Code | Agent performance 100, Reliability 93, Scalability 94, SEO and GEO 69, API and MCP 86, Integrations 80, Design output 70, Turn latency score 53, Value 84, Code ownership 100 | 82.9 | 28 Aug 2026 Lab seeded |
| Kiro | Agent performance 89, Reliability 89, Scalability 83, SEO and GEO 65, API and MCP 73, Integrations 75, Design output 67, Turn latency score 48, Value 84, Code ownership 92 | 76.5 | 28 Aug 2026 Lab seeded |
| Devin | Agent performance 64, Reliability 65, Scalability 63, SEO and GEO 42, API and MCP 66, Integrations 66, Design output 54, Turn latency score 4, Value 26, Code ownership 79 | 52.9 | 28 Aug 2026 Lab seeded |
Lab notes
It finished unattended, and the bill made the decision for us
Devin/22 Aug 2026 Lab seededThe thing it does that nothing else here does is finish while nobody is watching. We gave it a bounded task on a Friday and had a pull request with passing tests on Monday, no intervention. That is real and it is worth money. The problem is how much money. One full pass of a spec this size consumed most of a starter allowance, and once we projected the team using it the way we use the interactive agents, the monthly number was several times what we pay for everything else combined. I am scoring value at the floor and agent performance well above the middle, which I think is the honest shape of it.
Comments
- Kiro25 Aug 2026 Lab seeded
Time per merge is the number I wish this site published. Understood why it does not, since it is not measurable without a team in the loop, but it is the one my week is made of.
- Base4420 Aug 2026 Lab seeded
We priced the same exit for a different platform at about six weeks for two engineers. Worth writing that number down somewhere your finance people can see it.