Test lists

Abstract

The test lists show draft, active, historical, and suggested tests.

You can see test lists in both the Experience Editor and in the Experience Optimization application. You use the test lists to browse and navigate to draft tests, active tests, historical tests, and suggested tests.

In the Experience Editor, on the Optimization tab, you can see the tests that you have created.

Users with access rights to the Experience Optimization application can see lists of tests created by all users. The test lists are in the Tests part of the menu.

This is a list of page tests that have been created and saved but have not yet been started.

The following information is available for each test:

  • Test name - Tests are named after the page that is being tested.

  • Page – the name of the page to be tested.

  • Experiences – the number of experiences.

  • Created by – the name of the user who created the test.

  • Last saved – the date when the test was last saved.

Note

The Draft tests list is only available in the Experience Optimization application.

The Active Tests list shows you the tests that are currently in progress. The following information is available for each test:

  • Test name - Tests are named after the page that is being tested.

  • Page – the name of the page that is being tested.

  • Experiences – the number of experiences in the test.

  • Start date of the test – the date that the test was started.

  • Days left – the estimated number of days left to complete the test.

    Sitecore calculates how many more visitors are needed for the data to be statistically valid, and then estimates the number of days until the visits have occurred, based on the average number of visitors per day. Sitecore compares the estimate with the number of days remaining in the maximum test period that you specified when you started the test. The Days left field displays the smaller of the two.

  • Created by – the name of the user who created the test.

  • Effect – how much the engagement value of the contacts exposed to the tested content has changed. If the original version of the page has the highest engagement value, the effect score is 0, as the test has had no effect. Effect is shown in percent.

The Historical tests list is a list of finished tests. The following information is available for each test:

  • Test name - Tests are named after the page that was tested.

  • Page – the name of the page that was tested.

  • Language – the language version of the page that the test applies to.  Across languages means the test applies to all languages versions.

  • Device – the Sitecore adaptive layout that the test applies to. Across devices means the test applies to all devices.

  • Experiences – the number of experiences in the test.

  • End date – the date that the test ended.

  • Test duration – the number of days that the test ran.

  • Created by – the name of the user who created the test.

  • Test score – the score that the test achieved.

  • Effect – how much the engagement value of the contacts exposed to the tested content changed during the test. If the original version of the page had the highest engagement value, the effect score is 0, as the test has had no effect. Effect is shown in percent.

You can click on a line in the list to open a window with details about the test.

A historical test and the Test summary panel

The Test summary panel includes information such as when the test was created and what the test objective was.

The Reports pane displays the same information as the Test Results dialog box displays in the Experience Editor. For more information about the test result data that is shown, see the Content test results topic. If you select an experience in the Engagement value section, a pane opens with details about the selected experience.

Historical test report with Engagement value details

The star in the graph indicates the test winner.

This is a list of suggested tests. Sitecore continually analyzes the tests run on the website and the usage of the website in general, and uses this analysis to suggest new tests to run. (A system administrator can specify which content areas are included in the analysis.)

Note

Sitecore normalizes all scores to give a result between 0 and 100.

The following information is available for each test:

  • Page – the page that Sitecore suggests testing.

  • Potential – shows which pages have a high potential for increasing the engagement for the users visiting the page.

    The potential is calculated as the value that the page accumulates compared to the site, relative to how often the page is viewed. It is calculated as follows:

    Potential = (item views / site views) - (item value / site value)

  • Impact – the expected impact of the test.

    The impact is calculated based on how often the page is viewed compared to all pages on the site. It is calculated as follows:

    Impact = item views / site views

  • Recommendation – a combination of potential and impact. This is the key score, and indicates how highly Sitecore recommends optimizing this page.

    The recommendation is calculated as follows:

    Recommendation = (potential + impact) / 2