Skip to main content

Interpreting experiment test results in Sitecore Personalize

Abstract

Describes the difference between a winner and an inconclusive test result when viewing performance analytics for an experiment (Sitecore Personalize).

When you run an experiment in Sitecore Personalize, there are two general test results that can display on the Performance screen:

  • Winner - this result displays when a variant shows a statistically significant positive difference (% Improvement) from the baseline conversion rate. This is always based on the primary goal. If you see the¬†winner status banner, you can allocate all guest traffic to the variant winner.

  • Inconclusive - this result displays when the experiment is inconclusive. This happens when the performance for all variants is similar, showing no statistically significant positive or negative results. This is always based on the primary goal. The test continues to run.