![]() The most commonly used confidence level is 95%. If you roll out this Variant Recipe, there is only a one in 20 chance that you will not see a lift. ![]() If your two-sided test has a z-score of 1.96, you are 95% confident that that Variant Recipe is different than the Control Recipe. Z-scores are equated to confidence levels. What Does My Confidence Level Mean to Me in a Business Sense? We believe it’s just as important to know if your test is statistically underperforming as it is to know if it’s performing better than Control. With a one-sided test, you are only mathematically confident about one or the other, but never both. If you conduct a two-sided hypothesis test, you can be mathematically confident about whether or not your Variant Recipe is greater than or less than your Control Recipe. We use the Z-score calculator to test how far the center of the Variant bell curve is from the center of the Control bell curve. The Variant Recipe and all of the visitors in it make up a second bell curve. ![]() In A/B Testing terms, all of your visitors are observations, and the Control experience makes up a bell curve. ![]() Digital Analytics Platform Implementationįrequently Asked Questions What is a Z-Score?Ī z-score is a standardized score that describes how many standard deviations an element is from the mean.
0 Comments
Leave a Reply. |