This article explains how to understand cumulative performance graphs in your project.
On this page:
- What is cumulative performance?
- How cumulative performance is calculated
- Where to find cumulative performance graphs
What is cumulative performance?
Cumulative performance is the total relative change to control for a project version or combination.
How cumulative performance is calculated
Cumulative performance is calculated by dividing the difference in conversions between non-control and control by the control value.
Cumulative performance = (NC - C) / C
-
- C = Control Conversion Rate
- NC = Non-control Conversion Rate
Example
Say you have a project with control and three non-control combinations.
| Users | Conversions | Conversion Rate | |
| Control | 1000 | 200 | 20.00% |
| Combination 1 | 1000 | 220 | 22.00% |
| Combination 2 | 1000 | 180 | 18.00% |
| Combination 3 | 1000 | 300 | 30.00% |
| Non-Control (1,2,3) | 3000 | 700 | 23.33% |
Cumulative performance = (23.33 - 20.00) / 20.00 = 16.65%
Credible intervals
Evolv generates credible intervals for each phase and combination. Credible interval is the range of performance we expect to see 95% of the time.
Performance graphs show an upper and lower band around a solid line. These upper and lower values form the credible interval.
Absolute vs relative
Cumulative performance graphs show performance relative to control. You can view the absolute performance by ticking the 'include control' option.
Where to find cumulative performance graphs in your project
You can find cumulative performance in two places.
Project performance
On the Overview page is the project-level cumulative performance graph that includes all non-control combinations compared to control for the project's life.
- This includes all active and inactive combinations.
Cumulative performance statistics, relative and absolute (excluding and including control), will report information for each phase and not be aggregated across all project phases.
Combination performance
You'll find the cumulative performance graph for an individual combination in the side panel for that combination, which appears after you click it.
- Select your project in the Evolv AI Manager and go to the Combinations page.
- Click on any combination to open the side panel.
