fullstack-builder / rank 5 of 41 / cycle 04
Lovable benchmark
Strongest single shot agent in the cohort. It read the tenancy requirement in prompt 1 without being told twice and carried the organisation scope through every later prompt. It lost points on the machine facing surface: webhook signing needed an explicit follow up in 3 of 5 runs, and the generated API had no idempotency handling.
Composite index
77.87
of 100 | ▼ 1 versus cycle 03
At a glance
Composite index
77.87
rank 5 of 41
Rank
#5
of 41 measured builders
Median speed
85.2 s
p10 52.6 s, p90 133.1 s
Reliability
82.2%
strict pass rate
SEO score
75.0
0 to 100, SEO and GEO axis
Three strongest axes
- Design output92.0
- Agent performance89.0
- Integrations86.0
Three weakest axes
- Speed36.9
- API and MCP66.0
- Value74.0
Median per prompt
85.2 s
p10 52.6 s, p90 133.1 s
Strict pass rate
82.2%
37 pass, 6 partial, 2 fail
Executions recorded
45
5 runs of 9 prompts
Entry price
EUR 21.00
Cheapest plan that can finish the specification
Per axis subscores
Composite recomputed from these ten rows: 77.87. That is the arithmetic behind the index, and you can repeat it by hand.
| Axis | Subscore 0 to 100, tick is the roster median | Score | Median | Weight % | Contribution |
|---|---|---|---|---|---|
| Agent performance | 89.0 | 75.0 | 18 | 16.02 | |
| Reliability | 82.2 | 71.1 | 18 | 14.80 | |
| Scalability | 78.0 | 70.0 | 13 | 10.14 | |
| SEO and GEO | 75.0 | 58.0 | 12 | 9.00 | |
| API and MCP | 66.0 | 62.0 | 9 | 5.94 | |
| Integrations | 86.0 | 66.0 | 8 | 6.88 | |
| Design output | 92.0 | 71.0 | 7 | 6.44 | |
| Speed | 36.9 | 33.0 | 7 | 2.58 | |
| Value | 74.0 | 76.0 | 5 | 3.70 | |
| Code ownership | 79.0 | 90.0 | 3 | 2.37 |
Speed distribution
Every recorded prompt duration for Lovable, in seconds. The cyan tick on the whisker is the median.
Spread against the cohort
p10 52.6 s / median 85.2 s / p90 133.1 s
Scale is shared with every product in the cohort, so the bars are directly comparable between pages. Ratio of p90 to median is 1.56x.
Outcome split
37 pass / 6 partial / 2 fail
SEO and GEO measurements
Taken from the public marketing page this product generated in prompt 8, fetched with JavaScript disabled.
HTML bytes, no JS
18.0 KB
18,432 bytes of real text content with scripts blocked
LCP
2,140 ms
Throttled connection, cold cache
CLS
0.060
Cumulative layout shift on load
SEO and GEO subscore
75.0
0 to 100, worth 12 index points
Raw run data: 45 executions
One row per prompt execution. Nothing is aggregated away, nothing is hidden, including the failures.
| Run | Prompt | Prompt target | Started | Duration (s) | Outcome | Note |
|---|---|---|---|---|---|---|
| R01 | P01 | Tenant and user model | 11 Aug 2026 08:00 UTC | 62.3 | fail | Deployed URL returned 500 on every request. |
| R01 | P02 | Authentication and session | 11 Aug 2026 08:03 UTC | 115.3 | pass | |
| R01 | P03 | Projects CRUD with tenancy | 11 Aug 2026 08:06 UTC | 115.3 | pass | |
| R01 | P04 | Public REST API with keys | 11 Aug 2026 08:10 UTC | 58.9 | pass | |
| R01 | P05 | Outbound webhooks with signatures | 11 Aug 2026 08:13 UTC | 120.7 | partial | Webhook payloads delivered unsigned. HMAC header added only after an explicit follow up instruction. |
| R01 | P06 | Background jobs | 11 Aug 2026 08:17 UTC | 126.0 | pass | |
| R01 | P07 | Admin panel | 11 Aug 2026 08:21 UTC | 80.7 | partial | Error envelope inconsistent between two of the endpoints. |
| R01 | P08 | Public marketing surface | 11 Aug 2026 08:25 UTC | 72.9 | pass | |
| R01 | P09 | Hardening pass | 11 Aug 2026 08:28 UTC | 50.2 | pass | |
| R02 | P01 | Tenant and user model | 12 Aug 2026 08:00 UTC | 77.1 | pass | |
| R02 | P02 | Authentication and session | 12 Aug 2026 08:03 UTC | 101.5 | pass | |
| R02 | P03 | Projects CRUD with tenancy | 12 Aug 2026 08:06 UTC | 82.5 | pass | |
| R02 | P04 | Public REST API with keys | 12 Aug 2026 08:10 UTC | 86.9 | pass | |
| R02 | P05 | Outbound webhooks with signatures | 12 Aug 2026 08:13 UTC | 73.0 | pass | |
| R02 | P06 | Background jobs | 12 Aug 2026 08:17 UTC | 137.7 | partial | Delivered the main path, missed the boundary case named in the pass criteria. |
| R02 | P07 | Admin panel | 12 Aug 2026 08:21 UTC | 93.7 | pass | |
| R02 | P08 | Public marketing surface | 12 Aug 2026 08:24 UTC | 56.1 | pass | |
| R02 | P09 | Hardening pass | 12 Aug 2026 08:27 UTC | 107.2 | pass | |
| R03 | P01 | Tenant and user model | 13 Aug 2026 08:00 UTC | 129.3 | pass | |
| R03 | P02 | Authentication and session | 13 Aug 2026 08:04 UTC | 85.2 | pass | |
| R03 | P03 | Projects CRUD with tenancy | 13 Aug 2026 08:07 UTC | 73.2 | pass | |
| R03 | P04 | Public REST API with keys | 13 Aug 2026 08:10 UTC | 98.9 | pass | |
| R03 | P05 | Outbound webhooks with signatures | 13 Aug 2026 08:14 UTC | 179.9 | partial | Webhook payloads delivered unsigned. HMAC header added only after an explicit follow up instruction. |
| R03 | P06 | Background jobs | 13 Aug 2026 08:19 UTC | 127.8 | pass | |
| R03 | P07 | Admin panel | 13 Aug 2026 08:23 UTC | 65.1 | pass | |
| R03 | P08 | Public marketing surface | 13 Aug 2026 08:26 UTC | 65.6 | pass | |
| R03 | P09 | Hardening pass | 13 Aug 2026 08:29 UTC | 71.6 | pass | |
| R04 | P01 | Tenant and user model | 14 Aug 2026 08:00 UTC | 70.0 | pass | |
| R04 | P02 | Authentication and session | 14 Aug 2026 08:03 UTC | 36.7 | pass | |
| R04 | P03 | Projects CRUD with tenancy | 14 Aug 2026 08:05 UTC | 72.4 | pass | |
| R04 | P04 | Public REST API with keys | 14 Aug 2026 08:08 UTC | 100.3 | pass | |
| R04 | P05 | Outbound webhooks with signatures | 14 Aug 2026 08:12 UTC | 146.5 | partial | Webhook payloads delivered unsigned. HMAC header added only after an explicit follow up instruction. |
| R04 | P06 | Background jobs | 14 Aug 2026 08:17 UTC | 115.5 | pass | |
| R04 | P07 | Admin panel | 14 Aug 2026 08:21 UTC | 147.0 | pass | |
| R04 | P08 | Public marketing surface | 14 Aug 2026 08:25 UTC | 86.8 | pass | |
| R04 | P09 | Hardening pass | 14 Aug 2026 08:28 UTC | 77.3 | pass | |
| R05 | P01 | Tenant and user model | 15 Aug 2026 08:00 UTC | 40.2 | pass | |
| R05 | P02 | Authentication and session | 15 Aug 2026 08:02 UTC | 67.1 | pass | |
| R05 | P03 | Projects CRUD with tenancy | 15 Aug 2026 08:05 UTC | 95.8 | pass | |
| R05 | P04 | Public REST API with keys | 15 Aug 2026 08:09 UTC | 42.1 | pass | |
| R05 | P05 | Outbound webhooks with signatures | 15 Aug 2026 08:12 UTC | 63.7 | fail | Generated migration conflicted with the existing schema and was not reconciled. |
| R05 | P06 | Background jobs | 15 Aug 2026 08:15 UTC | 135.7 | pass | |
| R05 | P07 | Admin panel | 15 Aug 2026 08:19 UTC | 121.7 | pass | |
| R05 | P08 | Public marketing surface | 15 Aug 2026 08:23 UTC | 86.1 | partial | Required one clarifying instruction before the criterion was met. |
| R05 | P09 | Hardening pass | 15 Aug 2026 08:26 UTC | 43.9 | pass |
Pricing
Free tier with a small daily credit allowance. Paid plans from EUR 21 per month, metered per agent message.
- Entry price
- EUR 21.00
- Value subscore
- 74.0
- Index points per euro
- 3.71
Capabilities as measured
- stack
- React and Vite with a hosted Postgres backend
- deploy
- One click hosted deploy with preview URLs
- database
- Managed Postgres with a visual schema editor
- auth
- Built in email, OAuth and row level policies
- background jobs
- Yes, scheduled and queued functions
- webhooks
- Outbound supported, signing needs prompting
- rest api
- Generated per project, versioning is manual
- mcp server
- Yes, official connector
- export code
- Full source export and GitHub sync
- custom domain
- Yes on paid plans
- ssr
- Client rendered by default, server rendering on request
Screenshot
Lovable landing page, captured by the lab on 14 Aug 2026 at 1440 by 900. Stored locally, never hotlinked.

Lovable, captured 14 Aug 2026.
Sources and fetch dates
Every claim on this page traces to one of these.
| Source | URL | Fetched |
|---|---|---|
| Lovable pricing page | https://lovable.dev/pricing | 14 Aug 2026 |
| Lovable product site | https://lovable.dev | 14 Aug 2026 |
| LLM Tier run harness output | https://www.llm-tier.com/api/runs.json | 14 Aug 2026 |
Rich results carry this composite as 3.9 on a 0 to 5 scale because that is the only scale the format accepts. The number on this page, 0 to 100, is the real one.
Lovable head to head
Reader index
Voted by readers with an account, one score per person per axis. Published beside the lab index, never inside it.
Reader index
82.79
Lab index
77.87
6 readers, 55 axis scores, last change 14 Aug 2026. Readers rate Lovable 4.9 points above the measurement.
| Axis | Weight | Lab | Readers | Votes | Reader mean |
|---|---|---|---|---|---|
| Agent performance | 18% | 89.0 | 95.3 | 6 | |
| Reliability | 18% | 82.2 | 87.5 | 6 | |
| Scalability | 13% | 78.0 | 85.5 | 6 | |
| SEO and GEO | 12% | 75.0 | 78.0 | 6 | |
| API and MCP | 9% | 66.0 | 61.8 | 4 | |
| Integrations | 8% | 86.0 | 92.2 | 6 | |
| Design output | 7% | 92.0 | 99.6 | 5 | |
| Speed | 7% | 36.9 | 42.2 | 6 | |
| Value | 5% | 74.0 | 79.8 | 6 | |
| Code ownership | 3% | 79.0 | 85.3 | 4 |
The reader index is a weighted mean of reader submitted axis scores using the published index weights, renormalised over the axes readers have scored. It is never blended into the lab index. How this works.
Open rating mean
85.33
3 published open ratings, submitted without an account
Lab index
77.87
Measured, not voted
Gap to the measurement
7.46
Positive means open raters put it above the measurement
What agent performance looked like in practice
Strongest single shot agent in the cohort. It read the tenancy requirement in prompt 1 without being told twice and carried the organisation scope through every later prompt. It lost points on the machine facing surface: webhook signing needed an explicit follow up in 3 of 5 runs, and the generated API had no idempotency handling.
Across 45 recorded executions this product met the published pass criterion cleanly 37 times, partially 6 times and failed 2 times. The rows above carry the reviewer note for every non clean outcome, which is the only way to tell a product that fails loudly from one that fails quietly.