Experience Optimization and content testing glossary
Experience Optimization and content testing use the following concepts and terms.
A/B and A/B/N tests
One type of A/B test is the basic content test, which compares the effectiveness of two versions of a page. Another type of A/B test is a component test in which you compare different variants of a single component. If there are more than two variants, it is an A/B/N test. Page tests are also either A/B or A/B/N tests, depending on how many pages you test.
Best experience effect
The rate of change between the highest tested trailing value per visit and the original trailing value per visit.
Component test
A test of the different variations of a single component.
Confidence
The probability in percent that the difference between the results of the tested experiences after a test has reached the specified number of forecasted contacts is statistically significant.
Content test
A test that compares the performance of a new version of the content associated with a page item to the old version of that content.
Effect
The percentage that represents how much higher the trailing value is for a tested component compared to the original component. If the original component performs best, the effect is 0.
Experience
The combination of content that a contact sees on a single page.
Multivariate test
A multivariate test is a test which contains variants of more than one component on a page. The variants can differ in content or personalization. In a multivariate test, there can be many different combinations. For example, if there are 3 components with 3 variants each, they can be combined to make 27 different pages.
Page test
A test that compares one complete page against another page, for example, different versions of the same page or different pages.
Personalization test
A test of a combination of personalization rules that measures whether the rules have a positive effect on engagement value or goal conversion rates.
Reach
The number of contacts who have viewed a specific personalized variation of the content.
Scheduling
The minimum and maximum duration of a test.
Score
The effect of the test multiplied by the number of visits made to the page.
Segment
The group of visitors defined by one or more personalization rules.
Test objective
The measurement that you use to compare test results, for example, the trailing value of visits or the conversion rates of specific goals.
Trailing value/visit
The total engagement value for the variant of the content that is being content tested and that is based only on the page views that occur after the contacts have been exposed to the test, divided by the number of visits to the site with the variant.