LLMTier
Menu

Reader profile

Catarina Ferreira

Indie developer. Everything I run has to be free or nearly free, so the open source end of the index is where I live.
/u/cferreiraJoined 19 Aug 2026

Axis scores

63

Lab notes

1

Comments

1

Upvotes received

5

Axis scores

Reader scores feed the reader index column. The measured lab index is never affected by them.

ProductAxes scoredMeanLast change
AiderAgent performance 78, Reliability 78, SEO and GEO 64, API and MCP 69, Integrations 67, Design output 59, Turn latency score 86, Value 100, Code ownership 10077.928 Aug 2026 Lab seeded
ClineAgent performance 88, Reliability 90, SEO and GEO 70, API and MCP 88, Integrations 81, Design output 77, Turn latency score 50, Value 100, Code ownership 10082.729 Aug 2026 Lab seeded
OpenHandsAgent performance 81, Reliability 76, SEO and GEO 62, API and MCP 78, Integrations 69, Design output 62, Turn latency score 30, Value 98, Code ownership 10072.929 Aug 2026 Lab seeded
bolt.diyAgent performance 73, Reliability 61, SEO and GEO 75, API and MCP 49, Integrations 69, Design output 79, Turn latency score 32, Value 100, Code ownership 10070.929 Aug 2026 Lab seeded
DyadAgent performance 77, Reliability 61, SEO and GEO 82, API and MCP 64, Integrations 77, Design output 83, Turn latency score 45, Value 100, Code ownership 10076.629 Aug 2026 Lab seeded
ZedAgent performance 82, Reliability 89, SEO and GEO 60, API and MCP 75, Integrations 69, Design output 80, Turn latency score 100, Value 97, Code ownership 10083.629 Aug 2026 Lab seeded
RoomoteAgent performance 75, Reliability 62, SEO and GEO 64, API and MCP 71, Integrations 72, Design output 58, Turn latency score 41, Value 85, Code ownership 9769.429 Aug 2026 Lab seeded

Lab notes

  • Cheapest completed run I have recorded, by a lot

    Aider/22 Aug 2026 Lab seeded

    I tracked token spend across the nine prompts for four different agents. This one came in at roughly a third of the nearest commercial option and finished the spec, which is the part people leave out when they say the cheap option does not work. The discipline is what makes it cheap: it only reads the files you add, so you are not paying to send a repository through the model on every turn. The cost of that discipline is real too. Anything that needs a change across many files at once is slower and needs more of my attention, and prompt seven took me three attempts to steer.

    Open the reader page

Comments

  • Zed22 Aug 2026 Lab seeded

    Same conclusion from the free side. Bring your own key and the licence cost is zero, so more attempts per hour is close to more attempts per euro.