This article describes how to read the Experimentation Summary on the project Overview page.
The Experimentation Summary tile on the overview page tells you how many ideas are active and how many combinations are being evaluated. But what does it all mean?
Table of Contents
Understanding the Experimentation Summary
The below table explains the numbers based on the example above.
1,728 possible combinations
The number of possible combinations is based on the number of variants and variables that are enabled, including dormant variants
The number of enabled control and non-control variants in the project
The number of enabled variables in the project
1,152 are currently being evaluated
The total possible combinations of the active variants, excluding dormant variants.
How and why the numbers fluctuate
Combinations are made up of individual variants, so the total number of combinations that can be evaluated depends on the number of active variants.
A variant is considered dormant if it is no longer present in an active combination. A variant can be made dormant if the system decides it's not a viable option for new combinations or if it's waiting for other variants in the same variable to be initialized.
When a variant becomes dormant:
- The number of combinations being evaluated decreases.
The system might bring variants back as it explores new opportunities with existing or new variants.
When dormant variants become active:
- The number of combinations being evaluated increases.
Likewise, when new variants are added, the number of combinations being evaluated and the total possible combinations will increase.