All terms

CRO Glossary

Standard Error

A measure of how much a sample statistic, like a conversion rate, would vary across repeated samples from the same population.

Standard error tells you how precise an estimate is. If you ran the same experiment over and over with fresh samples, the standard error approximates how much your observed conversion rate would bounce around the true underlying rate. Smaller samples and more variable user behavior both push standard error up, which is why standard error shrinks as traffic accumulates.

Practitioners care about standard error because it is the building block behind confidence intervals, p-values, and significance checks. A lift might look impressive, but if the standard error is large relative to the effect, the result is probably noise rather than a real signal. Tools and dashboards often hide the raw standard error behind a confidence interval or a 'confidence level' badge, but it's the same underlying math.

For example, if a landing page converts at 5% with a standard error of 0.4 percentage points, you'd expect the true rate to usually fall within roughly plus or minus 0.8 points (about two standard errors) of that 5%. If a challenger variant converts at 5.3%, the overlap with that range makes it hard to call a winner yet, even though 5.3% is numerically higher than 5%.

Related terms

See this in the wild

ABWatcher watches how top teams apply standard error.

Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.