Skip to main content

Using statistical significance

Abstract

Describes what happens in an experiment when statistical significance is reached (Sitecore Personalize).

Sitecore Personalize ensures that any improvements shown in an experiment are due to changes made in the variant, as opposed to chance. If a winning variant has not been declared yet, the winner status banner does not display because the experiment has not reached statistical significance.

Statistical significance is the statistical likelihood of the improvement not being by chance. Sitecore Personalize analytics enables you to see how much longer it will take to reach statistical significance either by session count or unique visitor count. You can set which of these metrics you want to display on the Performance Analytics screen, when you add the goal.