Skip to main content

How to compare selected combinations in a new phase

Joshua Barnard
  • Updated

This article explains how to maximize conversions by driving more traffic to selected combinations in a new phase.

On this page:

A project includes multiple experiment phases. It starts in the Initialization phase, where the system collects baseline data for individual variants. It moves to an Optimization phase, where it generates multi-variant combinations and tries to find the best combination of ideas.

Depending on your optimization strategy, you might want to drive more traffic to the best-performing combinations to maximize overall conversions.

Evolv AI supports the creation of a new phase that lets you select which combinations you want to include and the percentage of traffic for the Control combination.

Important considerations

Before you create a new phase, consider the following questions.

Do I still want to find the best combination?

Continuous optimization is only possible during the Optimization phase. If you start a Comparison phase, you lock in the selected combinations. 

Where is the reporting source of truth?

The Comparison phase lets you select a custom amount of traffic for the Control combination. You can split the traffic equally or set a custom value as low as 1% of the total traffic.

When you reduce the traffic to Control, it takes longer for the system to evaluate its performance. This means there can be fluctuations in the performance shown in the Evolv AI Manager.

If you have low traffic or need to rely on the Manager for reporting, keep the Control traffic equal to that of the combinations.

Steps to compare selected combinations in a new phase

The ability to create a new phase is available by request. Please create a Zendesk ticket to request this feature for your account.

  1. Open the Manager and select your Project.
    • The project must be in the Optimization phase.
  2. Select the gear icon in the header to open the version settings panel.
    mceclip0.png
  3. Click the NEW PHASE button. 
    mceclip1.png
  4. When the modal appears, make sure the Compare selected combinations of variants option is selected, then click CONTINUE.
    mceclip2.png
  5. Select the required combinations, set the traffic percentage for Control, and click REVIEW to continue.
    • Uniform Allocation splits traffic between the selected combinations and Control evenly.
    • If you select Custom Allocation to Control, you can specify the percent of traffic manually (minimum 1%).
      mceclip3.png

      mceclip4.png
  6. Review the changes and click START PHASE.
    • The current Optimization phase will stop and the new Comparison phase is started.
      mceclip5.png
  7. You can see the new phase when you click on the gear icon again to open the version settings.
    • Reload the page if you don't see the new phase right away.
      mceclip6.png

Frequently asked questions

I started a comparison phase, but the combination numbers have changed. Is that correct?

Yes. Because it's a new phase, the system creates brand new combinations. The combinations were cloned from the selected combinations in the Optimization phase, they just have different numbers. There's even a new Control combination.

Related articles