All terms

CRO Glossary

Z-score

A standardized value showing how many standard deviations an observation or test statistic is from the mean.

A z-score converts a raw difference between two metrics (like conversion rates in a control and variant) into a standardized unit that accounts for variability in the data. It answers the question: given the amount of noise we'd expect by chance, how unusual is the difference we observed? Larger absolute z-scores mean the observed effect is less likely to be a fluke of random sampling.

In A/B testing, z-scores are the backbone of the classic two-proportion z-test used to compare conversion rates between variants. A z-score of 1.96 or higher (in absolute value) corresponds roughly to the 95% confidence threshold commonly used to call statistical significance in a two-tailed test. Most experimentation platforms compute this under the hood and simply surface a p-value or a 'significant/not significant' label, but the z-score is the actual mechanic driving that verdict.

For example, if a control converts at 10% and a variant at 11% on a large sample, the z-score tells you whether that one-point lift is a meaningful signal or well within the range of everyday sampling noise. A small sample might produce the same one-point lift with a z-score near zero, meaning the difference is statistically indistinguishable from chance.

Practitioners care about z-scores because they make it possible to compare test results across experiments of different sizes and baseline rates on a common scale, rather than eyeballing raw percentage differences.

Related terms

See this in the wild

ABWatcher watches how top teams apply z-score.

Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.