This article describes how to analyze combination performance in the Manager.
Evolv generates and displays Combinations of Variants to visitors during the project.
Information on the performance of individual combinations is provided in the project version.
Here is a view of the list of combinations in a project. Each combination can be selected to open a panel with more information.
Here is a view of the information panel for an individual Combination.
Summary Information
Evolv provides top-level information on a variant combination.
Basic Info
When the variant combination was active and how many people saw it.
Probability that new users will see it
Evolv adapts to serve higher performing variant combinations more frequently - this improves overall conversion rate and validates higher performers faster.
Probability to beat all
The probability that this variant combination is the best of all the currently live variant combinations.
Credible Interval
The likely range the experience will continue to perform in.
Cumulative Change from Control
A time series of performance of the variant combination. The observed difference from control is displayed, but also the computed expected range of performance at 95%.
This chart is equivalent to the view on the overview page, but for just the single variant combination.
Daily Visitors and Conversions
Absolute counts of the number of visitors and converting visitors seen each day. A visitor is counted only on the day they are first seen.
Variant Details
A list of the variants that make up the variant combination, with details of their performance. This data is from the project as a whole - not just from visitors who saw the selected variant combination.