The median turn latency is 95.1 seconds per prompt, not per whole build, which derives to 14.3 min across the full nine prompt specification. That is a tenth percentile of 47.4 seconds and a ninetieth percentile of 201.7 seconds across 45 recorded executions.

How reliable is Cline?

80.0% of recorded executions met the published pass criterion with no operator intervention. 8 were partial and 1 failed outright. Every one of those rows is published on this page.

Coding agents / rank 9 of 17 / cycle 04

Cline benchmark

An open source agent inside your editor that asks permission before each step, which is slower to drive and much easier to trust. It matched the commercial agents on the correctness prompts and lost time to the approval loop rather than to the model. Cost per full run was among the lowest we recorded because nothing is spent on a platform licence.

Last run: 15 Aug 2026 09:11 UTCNext scheduled run: n/aOfficial site Cline reviews and ratings

Composite index

70.66

of 100 | withheld vs. cycle 03

Delta not shown for cycle 04: the roster was re-based from one merged ranking into two class boards, so cycle 03 and cycle 04 ranks are not on the same scale. Resumes cycle 05.

At a glance

Composite index

70.66

rank 9 of 17

Rank

of 17 on the coding agents board

Median turn latency

95.1 s per prompt

14.3 min across the full nine prompt spec, derived

Reliability

80.0%

strict pass rate

SEO score

57.0

0 to 100, SEO and GEO axis

Three strongest axes

Value88.0
Agent performance82.0
Reliability80.0

Three weakest axes

Turn latency score33.0
SEO and GEO57.0
Design output63.0

Median turn latency

95.1 s per prompt

p10 47.4 s, p90 201.7 s

Strict pass rate

80.0%

36 pass, 8 partial, 1 fail

Executions recorded

5 runs of 9 prompts

Entry price

No licence fee, bring your own model key

Vendor's own unit and billing period. Never a currency conversion

Per axis subscores

Composite recomputed from these 9 rows: 70.66. That is the arithmetic behind the index, and you can repeat it by hand. Rounding rule: half up at two decimals, applied uniformly to all 37 published products. Code ownership has no row here: it is not scored on this board.

Weight table

Per axis subscores against the roster median, and weighted contribution
Axis	Score	Median	Weight %	Contribution
Reliability	80.0	75.6	18.56	14.85
Agent performance	82.0	80.0	18.55	15.21
Scalability	72.0	74.0	13.4	9.65
SEO and GEO	57.0	56.0	12.37	7.05
API and MCP	70.0	70.0	9.28	6.50
Integrations	72.0	70.0	8.25	5.94
Design output	63.0	62.0	7.22	4.55
Turn latency score	33.0	39.9	7.22	2.38
Value	88.0	80.0	5.15	4.53

Turn latency distribution

Every recorded prompt duration for Cline, in seconds. Median wall clock time for one prompt, not for a whole build. The cyan tick on the whisker is the median.

min 27.8 smax 477.0 s

Spread against the cohort

p10 47.4 s / median 95.1 s / p90 201.7 s

Scale is shared with every product in the cohort, so the bars are directly comparable between pages. Ratio of p90 to median is 2.12x.

Outcome split

36 pass / 8 partial / 1 fail

SEO and GEO measurements

Taken from the public marketing page this product generated in prompt 8, fetched with JavaScript disabled.

SEO and GEO leaderboard

HTML bytes, no JS

21.0 KB

21,504 bytes of real text content with scripts blocked

LCP

1,860 ms

Throttled connection, cold cache

CLS

0.040

Cumulative layout shift on load

SEO and GEO subscore

57.0

0 to 100, worth 12.37 index points on this board

Raw run data: 45 executions

One row per prompt execution. Nothing is aggregated away, nothing is hidden, including the failures.

JSON

Raw per run measurements
Run	Prompt	Prompt target	Started	Duration (s)	Outcome	Note
R01	P01	Tenant and user model	11 Aug 2026 08:00 UTC	86.8	pass
R01	P02	Authentication and session	11 Aug 2026 08:03 UTC	56.8	pass
R01	P03	Projects CRUD with tenancy	11 Aug 2026 08:06 UTC	128.8	pass
R01	P04	Public REST API with keys	11 Aug 2026 08:10 UTC	30.7	pass
R01	P05	Outbound webhooks with signatures	11 Aug 2026 08:13 UTC	88.9	pass
R01	P06	Background jobs	11 Aug 2026 08:16 UTC	153.2	partial	Pagination off by one at the final page boundary.
R01	P07	Admin panel	11 Aug 2026 08:21 UTC	73.4	pass
R01	P08	Public marketing surface	11 Aug 2026 08:24 UTC	56.1	pass
R01	P09	Hardening pass	11 Aug 2026 08:27 UTC	186.0	pass
R02	P01	Tenant and user model	12 Aug 2026 08:00 UTC	44.1	partial	Validation added on the write path only. Read path left unguarded.
R02	P02	Authentication and session	12 Aug 2026 08:02 UTC	66.7	pass
R02	P03	Projects CRUD with tenancy	12 Aug 2026 08:05 UTC	136.5	pass
R02	P04	Public REST API with keys	12 Aug 2026 08:10 UTC	73.8	pass
R02	P05	Outbound webhooks with signatures	12 Aug 2026 08:13 UTC	139.9	pass
R02	P06	Background jobs	12 Aug 2026 08:17 UTC	208.8	pass
R02	P07	Admin panel	12 Aug 2026 08:23 UTC	165.1	pass
R02	P08	Public marketing surface	12 Aug 2026 08:27 UTC	175.9	pass
R02	P09	Hardening pass	12 Aug 2026 08:32 UTC	126.7	pass
R03	P01	Tenant and user model	13 Aug 2026 08:00 UTC	49.1	partial	Pagination off by one at the final page boundary.
R03	P02	Authentication and session	13 Aug 2026 08:02 UTC	120.1	pass
R03	P03	Projects CRUD with tenancy	13 Aug 2026 08:06 UTC	156.4	pass
R03	P04	Public REST API with keys	13 Aug 2026 08:11 UTC	100.5	pass
R03	P05	Outbound webhooks with signatures	13 Aug 2026 08:15 UTC	82.5	pass
R03	P06	Background jobs	13 Aug 2026 08:18 UTC	477.0	pass
R03	P07	Admin panel	13 Aug 2026 08:28 UTC	264.5	pass
R03	P08	Public marketing surface	13 Aug 2026 08:34 UTC	71.6	partial	Pagination off by one at the final page boundary.
R03	P09	Hardening pass	13 Aug 2026 08:38 UTC	64.3	pass
R04	P01	Tenant and user model	14 Aug 2026 08:00 UTC	27.8	partial	Delivered the main path, missed the boundary case named in the pass criteria.
R04	P02	Authentication and session	14 Aug 2026 08:02 UTC	30.8	pass
R04	P03	Projects CRUD with tenancy	14 Aug 2026 08:04 UTC	70.7	partial	Required one clarifying instruction before the criterion was met.
R04	P04	Public REST API with keys	14 Aug 2026 08:08 UTC	73.0	pass
R04	P05	Outbound webhooks with signatures	14 Aug 2026 08:11 UTC	152.8	pass
R04	P06	Background jobs	14 Aug 2026 08:15 UTC	206.8	pass
R04	P07	Admin panel	14 Aug 2026 08:21 UTC	106.9	pass
R04	P08	Public marketing surface	14 Aug 2026 08:25 UTC	152.2	pass
R04	P09	Hardening pass	14 Aug 2026 08:29 UTC	95.1	pass
R05	P01	Tenant and user model	15 Aug 2026 08:00 UTC	46.3	partial	Error envelope inconsistent between two of the endpoints.
R05	P02	Authentication and session	15 Aug 2026 08:02 UTC	57.6	pass
R05	P03	Projects CRUD with tenancy	15 Aug 2026 08:05 UTC	194.1	partial	Delivered the main path, missed the boundary case named in the pass criteria.
R05	P04	Public REST API with keys	15 Aug 2026 08:10 UTC	154.3	pass
R05	P05	Outbound webhooks with signatures	15 Aug 2026 08:15 UTC	247.5	pass
R05	P06	Background jobs	15 Aug 2026 08:21 UTC	86.4	pass
R05	P07	Admin panel	15 Aug 2026 08:25 UTC	175.4	pass
R05	P08	Public marketing surface	15 Aug 2026 08:30 UTC	61.2	fail	Build did not start after deploy. Recorded as a fail with the log preserved.
R05	P09	Hardening pass	15 Aug 2026 08:33 UTC	74.0	pass

Pricing

Free and open source extension. You pay only for the model tokens you use.

Entry price: No licence fee, bring your own model key
Priced from: vendor pricing page
Value subscore: 88.0
Index points per euro: No licence fee

Entry price is the vendor's own published figure, fetched 21 Aug 2026, never a currency conversion. The currency label is the vendor's own except where the pricing note above records that this lab inferred it. Index points per euro is computed from a separate, euro-normalised figure used only for the Value axis: Converted at the European Central Bank euro reference rate of 1.1699 US dollars to the euro, August 21, 2026.

Capabilities as measured

stack: Your repository, any framework
deploy: Not included
database: Whatever you already run
auth: It wires the library you choose
background jobs: Implemented in your stack
webhooks: Signed when the criterion names it
rest api: Written to your conventions
mcp server: Yes
export code: Fully open source
custom domain: Your hosting decides
ssr: Your framework decides

Screenshot

Cline landing page, captured by the lab on 14 Aug 2026 at 1440 by 900. Stored locally, never hotlinked.

Cline landing page, captured by the lab at 1440 by 900

Cline, captured 14 Aug 2026.

Sources and fetch dates

Every claim on this page traces to one of these.

Sources with fetch dates
Source	URL	Fetched
Cline pricing page	https://cline.bot/pricing	14 Aug 2026
Cline product site	https://cline.bot	14 Aug 2026
LLM Tier run harness output	https://www.llm-tier.com/api/runs.json	14 Aug 2026

Rich results carry this composite as 3.5 on a 0 to 5 scale because that is the only scale the format accepts. The number on this page, 0 to 100, is the real one.

Cline head to head

aider vs cline

Reader index

Voted by readers with an account, one score per person per axis. Published beside the lab index, never inside it.

Score it or read the notes

Reader index

76.33

Lab index

70.66

3 readers, 28 axis scores, last change 29 Aug 2026. Readers rate Cline 5.7 points above the measurement.

Seeded at launch

The reader scores, lab notes and open ratings published here were written by this lab in August 2026 to populate the reader column before the site had readers. They are not customer submissions, they are not vendor supplied and nobody was paid for them. Anything submitted since then comes from a registered account. The lab index is measured from logged runs and is unaffected either way.

Reader mean against the measured lab subscore for each axis
Axis	Weight	Lab	Readers	Votes
Agent performance	18.55%	82.0	85.3	3
Reliability	18.56%	80.0	87.7	3
Scalability	13.4%	72.0	73.0	2
SEO and GEO	12.37%	57.0	61.0	2
API and MCP	9.28%	70.0	78.3	3
Integrations	8.25%	72.0	77.3	3
Design output	7.22%	63.0	70.3	3
Turn latency score	7.22%	33.0	44.0	3
Value	5.15%	88.0	97.0	3

The reader index is a weighted mean of reader submitted axis scores using the published index weights, renormalised over the axes readers have scored. It is never blended into the lab index. How this works.

Open rating mean

n/a

0 published open ratings, submitted without an account

Lab index

70.66

Measured, not voted

Gap to the measurement

n/a

Positive means open raters put it above the measurement

What agent performance looked like in practice

Across 45 recorded executions this product met the published pass criterion cleanly 36 times, partially 8 times and failed 1 times. The rows above carry the reviewer note for every non clean outcome, which is the only way to tell a product that fails loudly from one that fails quietly.