How to understand cumulative performance

This article explains how to understand cumulative performance graphs in your project.

On this page:

• What is cumulative performance?
• How cumulative performance is calculated
• Where to find cumulative performance graphs

What is cumulative performance?

Cumulative performance includes all historical data for a project version or combination. It can be relative or absolute, dependent on whether the "include control" option is selected. By default, it is relative ("include control" is not selected).

How cumulative performance is calculated

Relative cumulative performance is calculated by dividing the difference in conversions between non-control and control by the control value.

Relative cumulative performance = (NC - C) / C

• • C = Control Conversion Rate
  • NC = Non-control Conversion Rate

Example

Say you have a project with control and three non-control combinations. 

Relative cumulative performance = (23.33 - 20.00) / 20.00 = 16.65%

Credible intervals

Evolv generates credible intervals for each phase and combination. The credible interval is the range of performance we expect to see 95% of the time.

Performance graphs show an upper and lower band around a solid line. These upper and lower values form the credible interval.

Absolute vs relative

By default, cumulative performance graphs show performance relative to control. You can view the absolute performance by ticking the 'include control' option.

Where to find cumulative performance graphs in your project

You can find cumulative performance in two places.

Project performance

On the Overview page is the project-level cumulative performance graph that includes all non-control combinations compared to control for the project's life.

• This includes all active and inactive combinations.

Cumulative performance statistics, relative and absolute (excluding and including control), will report information for each phase and not be aggregated across all project phases.

Combination performance

You'll find the cumulative performance graph for an individual combination in the side panel for that combination, which appears after you click it.

1. Select your project in the Evolv AI Manager and go to the Combinations page.
2. Click on any combination to open the side panel.