This article explains why the system 'contaminates' a session and how to view them in a project or combination.
Table of Contents
What is a 'contamination'?
A contamination event occurs when something unusual happens during an experiment session.
When a contamination event occurs, the user becomes 'contaminated' and is excluded from the performance calculations and overall results seen in the Manager.
Contaminations are monitored daily to ensure experiments are working as expected.
The three primary contamination types are:
- Timeout-Exceeded - A timeout indicates the Evolv snippet could not load and apply changes within a specified window of time. By default, the threshold is 60 seconds. This contamination type is the most common and is often the result of a mobile user with a poor internet connection.
- Error-Thrown - This indicates a JavaScript error thrown by the experiment code. The error is often due to accessing or manipulating an invalid selector. Whenever we come across this type of contamination, we immediately look into the cause and resolve it quickly.
- Project-Paused - When an experiment is paused, any user assigned a non-control combination will begin to see Control. Since the user would technically see two different experiences, we exclude those users from the results.
Steps to check for contaminations in the Manager
All contaminations are recorded in the Manager. You can see the number and type of contaminations for a project or individual combination.
- Open the Evolv AI Manager and go to the LIVE tab for a project.
- On the Overview page, scroll down until you see the table of Total Unique Visitors.
- Below the table, you'll see the Contamination rate for the whole project. Click the Show details link to view the Daily Number of Contaminations.
- Click on a day in the graph to see that day's contamination events.
- To view contaminations for a particular combination, go to the Combinations page and click on a combination.
The Daily Contamination Rate is available when viewing a single day of contaminations. The graph of daily contaminations helps you understand when the contaminations started and stopped.