All Collections
A/B testing and analytics
Running A/B testing for 2 variations of a widget
Running A/B testing for 2 variations of a widget

Learn how to set up and run A/B testing for 2 variations of a widget

V
Written by Vitalii Shumilov
Updated over a week ago

A/B testing (or split testing) is a methodology for researching user experience. When running a test, you can split your audience to test different variations of your widget or launcher and determine which of them is performing better.


NOTE:

You cannot run A/B tests for the widgets:

  • Containing errors.

  • Having non-saved changes.

  • Used in another A/B testing.


To run an A/B testing for 2 widgets:

1. In the left-hand side panel, select A/B Testing and click the New test button.

2. Enter the test title and test description (optional) into the corresponding fields.

3. Click Select widget A and select the widget from the list in the Link the widget window.

NOTE: You can enter the widget name in the Search box to search for a widget by its name. Or you can use the following filters:

  • By update: Sort the widgets in the list by their updating dates.

  • Creation time: Select the creation time item from the dropdown list or select period to specify the custom period of widget creation.

4. Click Select widget B and select the widget from the list in the Link the widget window.

5. Enter the value in the Traffic allocation field for one of the widgets.

NOTE: The traffic allocation value specifies the distribution of displays for widgets A and B. The default value is 50 % for each widget. This means that the number of displays for both widgets is evenly distributed between all site or page visitors.

6. Click Start test.

If your widgets are not published the Start testing dialog window opens. Select Publish both widgets and start the test in the Start testing window.

The test shows in the A/B testing window with the active status.

The active tests are marked with the play icon beside their name. The completed tests are marked with the tick icon.

To stop the active test and leave both widgets published, expand the Stop dropdown menu and select Stop.

To stop the active test and unpublish both widgets, expand the Stop dropdown menu and select Stop and unpublish both, then click Stop in the dialog box.

NOTE: When you stop the active test, you will not be able to relaunch it.

To view the test statistics, click the test name.

Did this answer your question?