Skip to main content

View operational data for an experiment in Sitecore Personalize

Abstract

How to view operational data after the experiment is live (Sitecore Personalize).

When your experiment is live, you can start viewing how it is executing on the Operational screen. This lets you quickly see successful and failed executions, along with the executions average duration and the number of events being raised against the primary goal. The operational metrics are updated every 15 seconds.

To view operational data:

  1. On the navigation pane, click Experiments, Web to see performance analytics for a web experiment. Alternatively, click Experiments, Full Stack to see performance analytics for an interactive or triggered experiment. A list of experiments displays.

  2. Click the name of the experiment. The Build screen displays.

  3. Click the Operational menu item. The Operational screen displays:

Operational analytics for an experiment.

The following table contains a description of each numbered screen element at the top of the operational screen.

Screen item

Description

1. Name

This displays the proper name of the experiment or which you are viewing performance analytics. A Web ExperienceInteractive Experience, or Triggered Experience caption displays above the name.

2. Type

This tag displays to indicate whether the experiment was initially created for personalization or as an A/B test.

3. More drop-down list

Select the More drop-down list to duplicate, delete, or view history of the experiment.

4. Preview or Test button

Click the Preview button to test and preview a web experiment. The Test button only displays for interactive experiments. To test and configure the API response for an interactive experiment, click Test.

5. Status

Displays the current status of the experiment. The current status affects the Status change button that displays.

6. Status change button

Click to change the current status of the experiment. The button that displays depends on the current status.

A Draft status displays a Start button.

A Paused status displays a Start button.

A Live status displays a Pause button.

A Completed status displays a Duplicate button.

7. Performance

The Performance screen is selected by default when you open the experiment.

8. Operational

Click the Operational link to view operational metrics for the experiment.

9. Build

Click to view the configuration of the experiment.

10. Details

Click to view details of the experiment including when and who created it, and if it's a triggered experiment, schedule information.

11. Schedule

If this is a triggered experiment that is scheduled to run, this displays the date and timestamp of when the experiment starts executing and the end date, if applicable.

12. Avg Successful Executions per 15s

This displays the average number of successful executions per 15 seconds. This is a decimal percentage.

13. Avg Failed Executions per 15s

This displays the average number of failed executions per 15 seconds. This is a decimal percentage.

14. Time Duration Setting

To change the time duration that displays on the x axis of the timelines, select the required duration button: 15m: Click to set the time duration on the timeline to 15 minutes. This is the default setting. 3h: Click to set the time duration on the timeline to 3 hours. 2d: Click to set the time duration on the timeline to 2 days.

15. Execution Report

Click this button to view an execution report. You can also save the report to .pdf format.

16. Successful Executions

The number of successful executions for each variant, per the time duration button you selected; 15m3h, or 2d. To see this data on the timeline, hover your mouse over any lines on the timeline. An information callout displays.

17. Failed Executions

The number of failed executions for each variant, per the time duration button you selected; 15m3h, or 2d. To see this data on the timeline, hover your mouse over any lines on the timeline. An information callout displays.

18. Executions Average Duration

The average number of executions for each variant, per the time duration button you selected; 15m3h, or 2d. To see this data on the timeline, hover your mouse over any lines on the timeline. An information callout displays.

19. Primary Goal

Displays data on the timeline pertinent to the Primary Goal of the experiment. To see data for the primary goal on the timeline, hover your mouse over any lines on the timeline. An information callout displays.