Viewing the site's A/B/n tests
A/B testing enables you to refine user experiences, optimize digital strategies and calls to action, introduce new features with minimal risk, and ultimately increase engagement with your digital properties.
You can run A/B/n tests on components that are included in your site’s pages.
On the Sites dashboard, in the A/B/n test section, you can see the five latest created tests with the following information:
-
Name of the test.
-
Goal of the test, which can be Increase page view, Increase form submission, Decrease bounce rate, or Decrease exit rate.
-
State of the test, which can be:
-
Live - for tests currently running on a live website.
-
Draft - for tests created but not started.
-
Pending - for tests started but the page where the component is still needs to be published.
-
Ended - for tests that were ended.
-
Done - for tests that ended, but the page with the winning variant was not published after the test was ended.
-
-
If the test has a winning variant or not.
NoteSometimes, a test generates the message No data. This might be because the test is:
-
Still in draft or pending state.
-
Live but was started less than 24 hours ago.
-
Live but there has been no visitors to the page where the A/B test is running.
If you know that the test is live and that there were visits on the page more than 24 ago, and you still do not see any data, contact your Sitecore admin or open a support ticket.
-
You can click the down arrow to see detailed performance bars and metrics about the variants.
Viewing all A/B/n tests
To access more than the five latest tests created on the site, you can click View all in the top-right corner of the A/B/n tests section.
A table lists all the A/B/n tests with additional information about each test:
-
Test name - name given to the test.
-
Details - name of the page where the test runs and name of the component being tested.
-
Goal - Increase page view, Increase form submission, Decrease bounce rate, Decrease exit rate.
-
Performance - the test can have the following information: No data, No winning variant, or the name of the winning variant if there is one. Click on the performance bars to expand the information about a test, or hover the bar to get the test performance analytics.
-
Number of variants - number of variants being tested against the control.
-
Status - Draft, Pending, Live, Ended.
-
Start date - date where the test was started.
-
End date - date where the test ended, either because it reached statistical significance, or was ended manually.
-
Created - date the first variant created for the test was saved.
You can search the table by test name: the table is updated dynamically after you enter at least two characters in the search field. You can also filter the table by test state, goal, date, or time period.
You can use the edit icon at the end of a row to open a Started and Live test in the page builder.
Understanding the tests analytics
If available, click the arrow to the right of a test to see detailed performance bars and metrics about the variants.
The goal bars show the performance metric of each variant (including the control) against the goal. In the following example, the control has contributed to increasing page views by 19.35%, while the variant only contributed by 10.53%.
The uplift percentage is the percentage difference in conversion rate between the control and the variant. In the following example, the uplift value of the variant is negative, indicating that the control is better than the variant at achieving the goal, which is increasing the view of some specified pages.
To view additional analytics for A/B/n tests:
-
In the navigation header, click Analytics, then click Tests.