CRO Glossary
Lift
The relative or absolute difference in a metric between a test variant and the control, expressed as the improvement attributed to the change.
Lift is the headline number most stakeholders actually want from an experiment: how much better (or worse) did the variant perform compared to control. It's usually expressed as a relative percentage — for example, 'the new headline produced a 12% lift in signups' — though it can also be reported as an absolute difference in percentage points or raw counts.
Lift matters because it translates statistical output into a business-relevant statement, but it can also be misleading if reported without its confidence interval or significance level. A reported lift of 12% with a wide confidence interval spanning -2% to +26% is a very different claim than a 12% lift with a tight interval of +9% to +15%, even though the headline number is identical. Responsible reporting always pairs lift with its uncertainty range.
As a concrete example, if a control checkout page converts at 3.0% and a variant converts at 3.3%, the absolute lift is 0.3 percentage points, while the relative lift is 10%. Teams typically prefer relative lift for cross-experiment comparison, since it normalizes for differing baseline conversion rates across pages or segments.
A common pitfall is quoting lift from an underpowered test or from a metric peeked at mid-flight, which tends to overstate the true effect due to the winner's curse and regression to the mean — so lift figures should always be read alongside sample size and test duration.
Related terms
Shrinkage Estimator
A statistical adjustment that pulls noisy per-variant or per-segment estimates toward an overall average to reduce overfitting to randomness.
Flicker Test
A diagnostic check to confirm whether users briefly see the original page before a variant renders in client-side experiments.
Pre-Experiment Bucketing Audit
A review process confirming users are being randomly and evenly assigned to experiment variants before launch.
Above-Fold Exclusion Rule
A test-design rule that deliberately prevents changes to above-the-fold elements so an experiment isolates below-the-fold effects.
Flicker-Free Testing
A technical setup that prevents users from briefly seeing the original page before a test variant loads.
Orthogonal Test Design
A test structure where multiple variables are changed independently so their individual effects can be measured without interference.
See this in the wild
ABWatcher watches how top teams apply lift.
Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.