Skip to main content
Sitecore Documentation
  • Learn
  • Downloads
  • Changelog
  • Roadmap
PersonalizeCloud Portal
Sitecore Personalize
    • SitecoreAI experiments
    • Using the experiment list
    • Manage experiment details
    • Set automated post-test actions
    • Set up email notifications
        • Edit the sample size calculation
            • Using statistical significance
            • Adjusting the test sensitivity
    • Duplicate, delete, and view details
  • Using client-side JavaScript
  • Glossary
  1. Adjusting the confidence level of an experiment
  1. Sitecore Personalize
  2. Introduction to experiments in Sitecore Personalize
  3. Experiment metrics and calculations in Sitecore Personalize
  4. Adjusting the confidence level of an experiment
  5. Adjusting the test sensitivity of an experiment

Adjusting the test sensitivity of an experiment

You can decrease the minimum sample size required to reach statistical significance, although this decreases the confidence level. For example, you can reduce the minimum required sample size if you think it will take too long to reach statistical significance. This can happen if you are targeting an experiment to a webpage with a deep URL. You sometimes will not get enough traffic to reach statistical significance in the time you want.

There are other experiments for which you might want to increase the confidence level, even though it will increase the minimum sample size.

To account for this, you can increase the minimum detectable difference % to directly lower the required minimum sample size to reach statistical significance. That also means that the test will not be as sensitive, and will only show more drastic results.

If you have suggestions for improving this article, let us know!

© Copyright 2026, Sitecore A/S or a Sitecore affiliated company.
All rights reserved.

Privacy policySitecore Trust CenterTerms of use