Axis leaderboard / Reliability / weight 18 of 100

Most reliable AI app builders

Strict pass rate across 495 recorded prompt executions. How often the product completed a prompt cleanly rather than erroring, stalling, looping or producing a build that does not start.

Ranked by reliability

Ordered by axis subscore, highest first.

Most reliable AI app builders
#ToolReliabilityPass / partial / failExecutionsComposite
93.3
42/2/1
4576.31
93.0
42/2/1
4587.96
91.1
41/3/1
4580.30
88.9
40/3/2
4575.92
86.7
39/3/3
4578.65
86.7
39/5/1
4578.06
86.7
39/4/2
4573.42
84.4
38/6/1
4574.69
84.4
38/7/0
4570.54
82.2
37/6/2
4577.87
82.2
37/5/3
4571.52
80.0
36/8/1
4571.94
80.0
36/8/1
4571.51
80.0
36/3/6
4566.79
15Amp logoAmp
77.8
35/6/4
4574.04
77.8
35/8/2
4567.16
77.8
35/6/4
4567.13
75.6
34/7/4
4568.69
73.3
33/7/5
4571.91
73.3
33/7/5
4567.30
21Zed logoZed
71.1
32/5/8
4572.17
71.1
32/7/6
4566.36
68.9
31/7/7
4567.27
68.9
31/7/7
4566.89
68.9
31/8/6
4566.17
66.7
30/12/3
4560.10
64.4
29/9/7
4565.18
64.4
29/7/9
4563.18
60.0
27/8/10
4570.50
60.0
27/7/11
4560.16
60.0
27/8/10
4558.78
55.6
25/10/10
4564.77
55.6
25/10/10
4558.17
53.3
24/11/10
4561.04
53.3
24/8/13
4559.33
53.3
24/7/14
4556.79
53.3
24/12/9
4555.67
51.1
23/9/13
4562.25
51.1
23/11/11
4555.45
48.9
22/9/14
4556.55
48.9
22/10/13
4555.27

How the reliability axis is measured

Strict pass rate over all 45 recorded prompt executions per product. Partial completions and outright failures both cost. Timeouts above 20 minutes are recorded as a fail with the note preserved.

This axis carries 18 of the 100 index points. Each product completed 5 runs of 9 prompts in this cycle, and the underlying per run data behind every figure on this page is downloadable at /api/runs.json under a CC BY 4.0 licence.

A high score on one axis is not a recommendation. Read it against the composite column on the right and against the axes that matter for the work you have in front of you. Reliability at 93.3% for the leader of this cohort is the context for everything else on the page.

Other axis leaderboards