fullstack-builder / rank 4 of 41 / cycle 04
Firebase Studio benchmark
The widest integration surface of any builder we measured: auth, storage, scheduled functions and a managed datastore all attach without leaving the workspace. It pays for that in wall clock, since every prompt round trips through a provisioned cloud workspace rather than a local sandbox. Public pages came back client rendered unless server rendering was asked for by name, which is what holds the SEO subscore down.
Composite index
78.06
of 100 | ▼ 1 versus cycle 03
At a glance
Composite index
78.06
rank 4 of 41
Rank
#4
of 41 measured builders
Median speed
100.3 s
p10 65.8 s, p90 161.3 s
Reliability
86.7%
strict pass rate
SEO score
73.0
0 to 100, SEO and GEO axis
Three strongest axes
- Integrations90.0
- Scalability87.0
- Reliability86.7
Three weakest axes
- Speed31.3
- Design output72.0
- SEO and GEO73.0
Median per prompt
100.3 s
p10 65.8 s, p90 161.3 s
Strict pass rate
86.7%
39 pass, 5 partial, 1 fail
Executions recorded
45
5 runs of 9 prompts
Entry price
EUR 0.00
Cheapest plan that can finish the specification
Per axis subscores
Composite recomputed from these ten rows: 78.06. That is the arithmetic behind the index, and you can repeat it by hand.
| Axis | Subscore 0 to 100, tick is the roster median | Score | Median | Weight % | Contribution |
|---|---|---|---|---|---|
| Agent performance | 79.0 | 75.0 | 18 | 14.22 | |
| Reliability | 86.7 | 71.1 | 18 | 15.61 | |
| Scalability | 87.0 | 70.0 | 13 | 11.31 | |
| SEO and GEO | 73.0 | 58.0 | 12 | 8.76 | |
| API and MCP | 79.0 | 62.0 | 9 | 7.11 | |
| Integrations | 90.0 | 66.0 | 8 | 7.20 | |
| Design output | 72.0 | 71.0 | 7 | 5.04 | |
| Speed | 31.3 | 33.0 | 7 | 2.19 | |
| Value | 82.0 | 76.0 | 5 | 4.10 | |
| Code ownership | 84.0 | 90.0 | 3 | 2.52 |
Speed distribution
Every recorded prompt duration for Firebase Studio, in seconds. The cyan tick on the whisker is the median.
Spread against the cohort
p10 65.8 s / median 100.3 s / p90 161.3 s
Scale is shared with every product in the cohort, so the bars are directly comparable between pages. Ratio of p90 to median is 1.61x.
Outcome split
39 pass / 5 partial / 1 fail
SEO and GEO measurements
Taken from the public marketing page this product generated in prompt 8, fetched with JavaScript disabled.
HTML bytes, no JS
22.0 KB
22,528 bytes of real text content with scripts blocked
LCP
1,980 ms
Throttled connection, cold cache
CLS
0.050
Cumulative layout shift on load
SEO and GEO subscore
73.0
0 to 100, worth 12 index points
Raw run data: 45 executions
One row per prompt execution. Nothing is aggregated away, nothing is hidden, including the failures.
| Run | Prompt | Prompt target | Started | Duration (s) | Outcome | Note |
|---|---|---|---|---|---|---|
| R01 | P01 | Tenant and user model | 11 Aug 2026 08:00 UTC | 136.6 | partial | Delivered the main path, missed the boundary case named in the pass criteria. |
| R01 | P02 | Authentication and session | 11 Aug 2026 08:04 UTC | 121.0 | partial | Validation added on the write path only. Read path left unguarded. |
| R01 | P03 | Projects CRUD with tenancy | 11 Aug 2026 08:08 UTC | 123.1 | pass | |
| R01 | P04 | Public REST API with keys | 11 Aug 2026 08:12 UTC | 50.9 | pass | |
| R01 | P05 | Outbound webhooks with signatures | 11 Aug 2026 08:15 UTC | 125.4 | pass | |
| R01 | P06 | Background jobs | 11 Aug 2026 08:19 UTC | 73.2 | partial | Validation added on the write path only. Read path left unguarded. |
| R01 | P07 | Admin panel | 11 Aug 2026 08:22 UTC | 87.4 | pass | |
| R01 | P08 | Public marketing surface | 11 Aug 2026 08:25 UTC | 59.6 | pass | |
| R01 | P09 | Hardening pass | 11 Aug 2026 08:28 UTC | 91.0 | pass | |
| R02 | P01 | Tenant and user model | 12 Aug 2026 08:00 UTC | 96.2 | pass | |
| R02 | P02 | Authentication and session | 12 Aug 2026 08:03 UTC | 130.7 | pass | |
| R02 | P03 | Projects CRUD with tenancy | 12 Aug 2026 08:07 UTC | 100.3 | pass | |
| R02 | P04 | Public REST API with keys | 12 Aug 2026 08:11 UTC | 119.5 | pass | |
| R02 | P05 | Outbound webhooks with signatures | 12 Aug 2026 08:15 UTC | 176.4 | pass | |
| R02 | P06 | Background jobs | 12 Aug 2026 08:20 UTC | 89.3 | pass | |
| R02 | P07 | Admin panel | 12 Aug 2026 08:23 UTC | 95.1 | pass | |
| R02 | P08 | Public marketing surface | 12 Aug 2026 08:27 UTC | 179.5 | pass | |
| R02 | P09 | Hardening pass | 12 Aug 2026 08:32 UTC | 109.7 | pass | |
| R03 | P01 | Tenant and user model | 13 Aug 2026 08:00 UTC | 70.0 | pass | |
| R03 | P02 | Authentication and session | 13 Aug 2026 08:03 UTC | 69.0 | pass | |
| R03 | P03 | Projects CRUD with tenancy | 13 Aug 2026 08:06 UTC | 73.9 | pass | |
| R03 | P04 | Public REST API with keys | 13 Aug 2026 08:09 UTC | 94.9 | pass | |
| R03 | P05 | Outbound webhooks with signatures | 13 Aug 2026 08:13 UTC | 103.4 | pass | |
| R03 | P06 | Background jobs | 13 Aug 2026 08:16 UTC | 284.9 | pass | |
| R03 | P07 | Admin panel | 13 Aug 2026 08:23 UTC | 117.4 | pass | |
| R03 | P08 | Public marketing surface | 13 Aug 2026 08:27 UTC | 87.6 | pass | |
| R03 | P09 | Hardening pass | 13 Aug 2026 08:31 UTC | 117.1 | fail | Task abandoned by the agent with no artifact produced. |
| R04 | P01 | Tenant and user model | 14 Aug 2026 08:00 UTC | 31.0 | pass | |
| R04 | P02 | Authentication and session | 14 Aug 2026 08:02 UTC | 64.5 | pass | |
| R04 | P03 | Projects CRUD with tenancy | 14 Aug 2026 08:05 UTC | 164.3 | pass | |
| R04 | P04 | Public REST API with keys | 14 Aug 2026 08:10 UTC | 133.7 | pass | |
| R04 | P05 | Outbound webhooks with signatures | 14 Aug 2026 08:14 UTC | 119.5 | pass | |
| R04 | P06 | Background jobs | 14 Aug 2026 08:18 UTC | 114.6 | pass | |
| R04 | P07 | Admin panel | 14 Aug 2026 08:22 UTC | 77.2 | pass | |
| R04 | P08 | Public marketing surface | 14 Aug 2026 08:25 UTC | 67.8 | pass | |
| R04 | P09 | Hardening pass | 14 Aug 2026 08:28 UTC | 156.8 | pass | |
| R05 | P01 | Tenant and user model | 15 Aug 2026 08:00 UTC | 111.6 | partial | Required one clarifying instruction before the criterion was met. |
| R05 | P02 | Authentication and session | 15 Aug 2026 08:03 UTC | 80.5 | pass | |
| R05 | P03 | Projects CRUD with tenancy | 15 Aug 2026 08:07 UTC | 100.4 | pass | |
| R05 | P04 | Public REST API with keys | 15 Aug 2026 08:10 UTC | 88.0 | pass | |
| R05 | P05 | Outbound webhooks with signatures | 15 Aug 2026 08:14 UTC | 96.8 | pass | |
| R05 | P06 | Background jobs | 15 Aug 2026 08:17 UTC | 120.7 | pass | |
| R05 | P07 | Admin panel | 15 Aug 2026 08:21 UTC | 71.6 | pass | |
| R05 | P08 | Public marketing surface | 15 Aug 2026 08:25 UTC | 63.6 | partial | Error envelope inconsistent between two of the endpoints. |
| R05 | P09 | Hardening pass | 15 Aug 2026 08:28 UTC | 210.5 | pass |
Pricing
No seat price during preview. The generated project bills through the underlying cloud plan, so the running cost depends on usage rather than a licence.
- Entry price
- EUR 0.00
- Value subscore
- 82.0
- Index points per euro
- 78.06
Capabilities as measured
- stack
- Framework of your choice inside a cloud workspace
- deploy
- Managed hosting with preview channels
- database
- Managed document store, relational engine on request
- auth
- First party auth with provider plugins
- background jobs
- Yes, scheduled and event triggered functions
- webhooks
- Outbound supported, signing written by hand
- rest api
- Generated per function, no key manager by default
- mcp server
- Yes
- export code
- Full source, standard project layout
- custom domain
- Yes
- ssr
- Client rendered unless requested
Screenshot
Firebase Studio landing page, captured by the lab on 14 Aug 2026 at 1440 by 900. Stored locally, never hotlinked.

Firebase Studio, captured 14 Aug 2026.
Sources and fetch dates
Every claim on this page traces to one of these.
| Source | URL | Fetched |
|---|---|---|
| Firebase Studio pricing page | https://firebase.studio/pricing | 14 Aug 2026 |
| Firebase Studio product site | https://firebase.studio | 14 Aug 2026 |
| LLM Tier run harness output | https://www.llm-tier.com/api/runs.json | 14 Aug 2026 |
Rich results carry this composite as 3.9 on a 0 to 5 scale because that is the only scale the format accepts. The number on this page, 0 to 100, is the real one.
Firebase Studio head to head
Reader index
Voted by readers with an account, one score per person per axis. Published beside the lab index, never inside it.
Reader index
74.74
Lab index
78.06
5 readers, 42 axis scores, last change 15 Aug 2026. Readers rate Firebase Studio 3.3 points below the measurement.
| Axis | Weight | Lab | Readers | Votes | Reader mean |
|---|---|---|---|---|---|
| Agent performance | 18% | 79.0 | 75.4 | 5 | |
| Reliability | 18% | 86.7 | 85.8 | 5 | |
| Scalability | 13% | 87.0 | 80.6 | 5 | |
| SEO and GEO | 12% | 73.0 | 68.4 | 5 | |
| API and MCP | 9% | 79.0 | 74.3 | 4 | |
| Integrations | 8% | 90.0 | 86.4 | 5 | |
| Design output | 7% | 72.0 | 73.0 | 1 | |
| Speed | 7% | 31.3 | 28.8 | 5 | |
| Value | 5% | 82.0 | 78.3 | 3 | |
| Code ownership | 3% | 84.0 | 80.0 | 4 |
The reader index is a weighted mean of reader submitted axis scores using the published index weights, renormalised over the axes readers have scored. It is never blended into the lab index. How this works.
Open rating mean
n/a
0 published open ratings, submitted without an account
Lab index
78.06
Measured, not voted
Gap to the measurement
n/a
Positive means open raters put it above the measurement
What agent performance looked like in practice
The widest integration surface of any builder we measured: auth, storage, scheduled functions and a managed datastore all attach without leaving the workspace. It pays for that in wall clock, since every prompt round trips through a provisioned cloud workspace rather than a local sandbox. Public pages came back client rendered unless server rendering was asked for by name, which is what holds the SEO subscore down.
Across 45 recorded executions this product met the published pass criterion cleanly 39 times, partially 5 times and failed 1 times. The rows above carry the reviewer note for every non clean outcome, which is the only way to tell a product that fails loudly from one that fails quietly.