Skip to main content

About A/B Test Projects

Joshua Barnard
  • Updated

This article reviews what A/B tests are and when/how you can use Evolv AI to run one. 

Table of Contents

What is an A/B test?

An A/B test is a type of experimentation where only single ideas are tested against a control. It contains a single experimentation phase and does not automatically change the active ideas.

See how A/B testing compares to Continuous Optimization.

Experimentation Type Phases Combinations
Continuous Optimization Multi-phase approach: Initialization + Optimization Automatically creates new combinations of variants to find the top performer.
A/B Test Single phase

Each variant belongs to a single combination for the entirety of the phase.

When should I use the A/B test experimentation type?

You should use the A/B test type if you only want to test single ideas. This includes URL redirects.

  • If you want to optimize for the best combination of variants, use Continuous Optimization instead.

Steps to create an A/B test

  1. Create a new project in the Evolv AI Manager.
  2. Select A/B Test from the Experimentation Type option.
    abtest-new.png
  3. Click SAVE and open the project.
    abtest-import.png
  4. Click MANAGE EXPERIMENTATION and import variables using the project file you saved from the Web Editor.
    • Your project file can contain multiple variables. As this is an A/B test, each variant is tested in isolation.
      abtest-import-diff.png
  5. Select an Audience and Optimization Metric, then click Move to Live when ready to deploy.
  6. Your A/B test is now live.

How does A/B test reporting differ from Continuous Optimization?

We only show variant performance instead of combinations because there is no difference between the variants being tested and the combination that are created at the start of the project.

All other Overview performance charts will continue to show you how the project version performs.

Related articles