The median turn latency is 39.4 seconds per prompt, not per whole build, which derives to 5.9 min across the full nine prompt specification. That is a tenth percentile of 22.5 seconds and a ninetieth percentile of 75.7 seconds across 45 recorded executions.

How reliable is Aider?

68.9% of recorded executions met the published pass criterion with no operator intervention. 7 were partial and 7 failed outright. Every one of those rows is published on this page.

Coding agents / rank 13 of 17 / cycle 04

Aider benchmark

The second fastest median in the whole index and by some distance the cheapest per completed prompt. It works on a small explicit set of files and commits as it goes, which is excellent discipline and also why it scores lower on the prompts that need a change across many files at once. Nothing about it is hosted, so there is no platform risk at all.

Last run: 15 Aug 2026 09:11 UTCNext scheduled run: n/aOfficial site Aider reviews and ratings

Composite index

65.88

of 100 | withheld vs. cycle 03

Delta not shown for cycle 04: the roster was re-based from one merged ranking into two class boards, so cycle 03 and cycle 04 ranks are not on the same scale. Resumes cycle 05.

At a glance

Composite index

65.88

rank 13 of 17

Rank

#13

of 17 on the coding agents board

Median turn latency

39.4 s per prompt

5.9 min across the full nine prompt spec, derived

Reliability

68.9%

strict pass rate

SEO score

54.0

0 to 100, SEO and GEO axis

Three strongest axes

Value86.0
Turn latency score79.7
Agent performance72.0

Three weakest axes

Design output52.0
SEO and GEO54.0
Integrations58.0

Median turn latency

39.4 s per prompt

p10 22.5 s, p90 75.7 s

Strict pass rate

68.9%

31 pass, 7 partial, 7 fail

Executions recorded

5 runs of 9 prompts

Entry price

No licence fee, bring your own model key

Vendor's own unit and billing period. Never a currency conversion

Per axis subscores

Composite recomputed from these 9 rows: 65.88. That is the arithmetic behind the index, and you can repeat it by hand. Rounding rule: half up at two decimals, applied uniformly to all 37 published products. Code ownership has no row here: it is not scored on this board.

Weight table

Per axis subscores against the roster median, and weighted contribution
Axis	Score	Median	Weight %	Contribution
Reliability	68.9	75.6	18.56	12.79
Agent performance	72.0	80.0	18.55	13.36
Scalability	64.0	74.0	13.4	8.58
SEO and GEO	54.0	56.0	12.37	6.68
API and MCP	62.0	70.0	9.28	5.75
Integrations	58.0	70.0	8.25	4.79
Design output	52.0	62.0	7.22	3.75
Turn latency score	79.7	39.9	7.22	5.75
Value	86.0	80.0	5.15	4.43

Turn latency distribution

Every recorded prompt duration for Aider, in seconds. Median wall clock time for one prompt, not for a whole build. The cyan tick on the whisker is the median.

min 18.0 smax 181.6 s

Spread against the cohort

p10 22.5 s / median 39.4 s / p90 75.7 s

Scale is shared with every product in the cohort, so the bars are directly comparable between pages. Ratio of p90 to median is 1.92x.

Outcome split

31 pass / 7 partial / 7 fail

SEO and GEO measurements

Taken from the public marketing page this product generated in prompt 8, fetched with JavaScript disabled.

SEO and GEO leaderboard

HTML bytes, no JS

17.0 KB

17,408 bytes of real text content with scripts blocked

LCP

1,920 ms

Throttled connection, cold cache

CLS

0.050

Cumulative layout shift on load

SEO and GEO subscore

54.0

0 to 100, worth 12.37 index points on this board

Raw run data: 45 executions

One row per prompt execution. Nothing is aggregated away, nothing is hidden, including the failures.

JSON

Raw per run measurements
Run	Prompt	Prompt target	Started	Duration (s)	Outcome	Note
R01	P01	Tenant and user model	11 Aug 2026 08:00 UTC	22.1	partial	Validation added on the write path only. Read path left unguarded.
R01	P02	Authentication and session	11 Aug 2026 08:02 UTC	25.1	pass
R01	P03	Projects CRUD with tenancy	11 Aug 2026 08:04 UTC	58.2	pass
R01	P04	Public REST API with keys	11 Aug 2026 08:07 UTC	25.4	pass
R01	P05	Outbound webhooks with signatures	11 Aug 2026 08:10 UTC	57.2	fail	Generated migration conflicted with the existing schema and was not reconciled.
R01	P06	Background jobs	11 Aug 2026 08:13 UTC	80.9	pass
R01	P07	Admin panel	11 Aug 2026 08:16 UTC	24.4	pass
R01	P08	Public marketing surface	11 Aug 2026 08:18 UTC	20.5	partial	Required one clarifying instruction before the criterion was met.
R01	P09	Hardening pass	11 Aug 2026 08:21 UTC	24.8	pass
R02	P01	Tenant and user model	12 Aug 2026 08:00 UTC	41.7	pass
R02	P02	Authentication and session	12 Aug 2026 08:02 UTC	34.7	pass
R02	P03	Projects CRUD with tenancy	12 Aug 2026 08:05 UTC	27.6	pass
R02	P04	Public REST API with keys	12 Aug 2026 08:07 UTC	26.1	partial	Error envelope inconsistent between two of the endpoints.
R02	P05	Outbound webhooks with signatures	12 Aug 2026 08:10 UTC	80.3	pass
R02	P06	Background jobs	12 Aug 2026 08:13 UTC	73.5	pass
R02	P07	Admin panel	12 Aug 2026 08:16 UTC	26.6	fail	Agent looped on the same edit for the full timeout window of 20 minutes.
R02	P08	Public marketing surface	12 Aug 2026 08:19 UTC	25.2	pass
R02	P09	Hardening pass	12 Aug 2026 08:21 UTC	50.7	pass
R03	P01	Tenant and user model	13 Aug 2026 08:00 UTC	23.3	pass
R03	P02	Authentication and session	13 Aug 2026 08:02 UTC	41.7	pass
R03	P03	Projects CRUD with tenancy	13 Aug 2026 08:05 UTC	64.2	pass
R03	P04	Public REST API with keys	13 Aug 2026 08:08 UTC	63.5	pass
R03	P05	Outbound webhooks with signatures	13 Aug 2026 08:11 UTC	48.9	pass
R03	P06	Background jobs	13 Aug 2026 08:14 UTC	77.2	pass
R03	P07	Admin panel	13 Aug 2026 08:17 UTC	42.2	fail	Agent looped on the same edit for the full timeout window of 20 minutes.
R03	P08	Public marketing surface	13 Aug 2026 08:20 UTC	32.2	fail	Agent looped on the same edit for the full timeout window of 20 minutes.
R03	P09	Hardening pass	13 Aug 2026 08:22 UTC	18.3	pass
R04	P01	Tenant and user model	14 Aug 2026 08:00 UTC	30.6	partial	Delivered the main path, missed the boundary case named in the pass criteria.
R04	P02	Authentication and session	14 Aug 2026 08:02 UTC	23.9	pass
R04	P03	Projects CRUD with tenancy	14 Aug 2026 08:04 UTC	59.4	partial	Validation added on the write path only. Read path left unguarded.
R04	P04	Public REST API with keys	14 Aug 2026 08:07 UTC	23.7	pass
R04	P05	Outbound webhooks with signatures	14 Aug 2026 08:10 UTC	181.6	pass
R04	P06	Background jobs	14 Aug 2026 08:15 UTC	101.0	fail	Generated migration conflicted with the existing schema and was not reconciled.
R04	P07	Admin panel	14 Aug 2026 08:19 UTC	37.2	pass
R04	P08	Public marketing surface	14 Aug 2026 08:21 UTC	39.2	pass
R04	P09	Hardening pass	14 Aug 2026 08:24 UTC	40.7	pass
R05	P01	Tenant and user model	15 Aug 2026 08:00 UTC	56.3	pass
R05	P02	Authentication and session	15 Aug 2026 08:02 UTC	18.6	partial	Error envelope inconsistent between two of the endpoints.
R05	P03	Projects CRUD with tenancy	15 Aug 2026 08:05 UTC	59.6	pass
R05	P04	Public REST API with keys	15 Aug 2026 08:08 UTC	49.7	pass
R05	P05	Outbound webhooks with signatures	15 Aug 2026 08:11 UTC	18.0	fail	Build did not start after deploy. Recorded as a fail with the log preserved.
R05	P06	Background jobs	15 Aug 2026 08:13 UTC	60.4	pass
R05	P07	Admin panel	15 Aug 2026 08:16 UTC	64.1	partial	Delivered the main path, missed the boundary case named in the pass criteria.
R05	P08	Public marketing surface	15 Aug 2026 08:19 UTC	23.1	pass
R05	P09	Hardening pass	15 Aug 2026 08:21 UTC	39.4	fail	Build did not start after deploy. Recorded as a fail with the log preserved.

Pricing

Free and open source. You pay only for the model tokens you use.

Entry price: No licence fee, bring your own model key
Priced from: vendor pricing page
Value subscore: 86.0
Index points per euro: No licence fee

Entry price is the vendor's own published figure, fetched 21 Aug 2026, never a currency conversion. The currency label is the vendor's own except where the pricing note above records that this lab inferred it. Index points per euro is computed from a separate, euro-normalised figure used only for the Value axis: Converted at the European Central Bank euro reference rate of 1.1699 US dollars to the euro, August 21, 2026.

Capabilities as measured

stack: Your repository, any framework
deploy: Not included
database: Whatever you already run
auth: It wires the library you choose
background jobs: Implemented in your stack
webhooks: Hand guided
rest api: Written to your conventions
mcp server: Partial
export code: Fully open source, commits to your git history
custom domain: Your hosting decides
ssr: Your framework decides

Screenshot

Aider landing page, captured by the lab on 14 Aug 2026 at 1440 by 900. Stored locally, never hotlinked.

Aider landing page, captured by the lab at 1440 by 900

Aider, captured 14 Aug 2026.

Sources and fetch dates

Every claim on this page traces to one of these.

Sources with fetch dates
Source	URL	Fetched
Aider pricing page	https://aider.chat/pricing	14 Aug 2026
Aider product site	https://aider.chat	14 Aug 2026
LLM Tier run harness output	https://www.llm-tier.com/api/runs.json	14 Aug 2026

Rich results carry this composite as 3.3 on a 0 to 5 scale because that is the only scale the format accepts. The number on this page, 0 to 100, is the real one.

Aider head to head

aider vs cline

Reader index

Voted by readers with an account, one score per person per axis. Published beside the lab index, never inside it.

Score it or read the notes

Reader index

70.44

Lab index

65.88

3 readers, 28 axis scores, last change 28 Aug 2026. Readers rate Aider 4.6 points above the measurement.

Seeded at launch

The reader scores, lab notes and open ratings published here were written by this lab in August 2026 to populate the reader column before the site had readers. They are not customer submissions, they are not vendor supplied and nobody was paid for them. Anything submitted since then comes from a registered account. The lab index is measured from logged runs and is unaffected either way.

Reader mean against the measured lab subscore for each axis
Axis	Weight	Lab	Readers	Votes
Agent performance	18.55%	72.0	79.7	3
Reliability	18.56%	68.9	70.7	3
Scalability	13.4%	64.0	65.5	2
SEO and GEO	12.37%	54.0	60.5	2
API and MCP	9.28%	62.0	67.0	3
Integrations	8.25%	58.0	63.0	3
Design output	7.22%	52.0	49.7	3
Turn latency score	7.22%	79.7	85.0	3
Value	5.15%	86.0	100.0	3

The reader index is a weighted mean of reader submitted axis scores using the published index weights, renormalised over the axes readers have scored. It is never blended into the lab index. How this works.

Open rating mean

n/a

0 published open ratings, submitted without an account

Lab index

65.88

Measured, not voted

Gap to the measurement

n/a

Positive means open raters put it above the measurement

What agent performance looked like in practice

Across 45 recorded executions this product met the published pass criterion cleanly 31 times, partially 7 times and failed 7 times. The rows above carry the reviewer note for every non clean outcome, which is the only way to tell a product that fails loudly from one that fails quietly.