Run an experiment with optimized testing
By default, Sitecore Personalize utilizes the classic A/B test methodology for an experiment. However, you have the option to use optimized testing for both web and interactive experiments. Enabling this option eliminates any manual traffic allocation on your part and dynamically assigns guests using the Multi-armed bandit algorithm. It also tracks performance based on set goals.
To enable optimized testing:
-
In the Experiment options pane, click the Optimized option. Doing so will hide other configurations in the pane.
NoteSelecting the Optimized option activates optimized testing, which prevents you from selecting the Unique and Universal assignment methods or adjusting how you allocate traffic. This option will automatically allocate 100% of the traffic to your experiment, and dynamically assign guests to the highest performing variants.
-
In the experiment builder, in the Goals tile, add a primary goal. You can add secondary goals to track additional metrics. Sitecore Personalize tracks all goals added, but uses the primary goal to determine the winning variant.
-
You can configure the experiment further or, if you are ready, you can start the experiment. When it is started, you can immediately see operational data. Within 24 hours, you can also see the dynamic traffic allocation and view performance analytics.