Evolv evaluates the performance of the individual variants within a project.
This allows for a better understanding of which specific ideas and hypotheses work well or poorly. So for example, when you are getting ready to implement a winning combination, you can investigate the performance of each variant in that combination, and then decide to leave out certain variants that are not the ones driving the highest performance.
Variants Graph
This report shows the relative change from control of an individual variant and the probability Evolv will show it to a new visitor. Generally, you should see that variants with a negative change have a low chance of being seen. Variants that perform well will have a higher chance of being shown.
Statistically significant variants are displayed in solid green.
Variables and Variants Performance
This tables gives the detailed information on each variant.
Visitors that saw it to date
A basic count of all visitors who have ever seen the variant.
Probability that new visitors will see it
Each variant can exist in multiple variant combinations that are eligible to be shown to visitors. Each variant combination has an associated probability of being allocated to a user based on its performance. These probabilities are aggregated to generate the probability that any new visitor will see each variant.
The spark line shows how this value has changed over time.
Credible Interval
The expected performance range of the variant at a 95% confidence level
Statistically Significant?
Whether or not the variant has achieved statistical significance, which means that the system has concluded that the difference in conversion rates between a given variant and the control is not due to random chance, with 95% certainty.