CRO Glossary
Uplift
The measured increase (or decrease) in a metric caused by a treatment, relative to what would have happened without it.
Uplift is the causal difference an experiment is designed to isolate: the change in a metric that can be attributed specifically to the treatment, as opposed to noise, seasonality, or other factors. It's closely related to effect size, but 'uplift' is typically used specifically to describe an increase, often expressed as a percentage lift over control.
Uplift modeling extends this idea beyond a single average number by trying to predict which individual users or segments respond most positively to a treatment, versus which are indifferent or even respond negatively (sometimes called 'sleeping dogs'). This is more advanced than a simple segment analysis done after the fact, since it's built explicitly to find heterogeneous treatment effects.
A practical example: a promotional email might show an overall uplift of 2% in click-through, but uplift modeling might reveal that the effect is concentrated entirely among lapsed users, with no effect (or a slight negative effect) among currently active users. Understanding uplift at this level helps teams target treatments more precisely rather than rolling them out uniformly to everyone.
Related terms
Shrinkage Estimator
A statistical adjustment that pulls noisy per-variant or per-segment estimates toward an overall average to reduce overfitting to randomness.
Flicker Test
A diagnostic check to confirm whether users briefly see the original page before a variant renders in client-side experiments.
Pre-Experiment Bucketing Audit
A review process confirming users are being randomly and evenly assigned to experiment variants before launch.
Above-Fold Exclusion Rule
A test-design rule that deliberately prevents changes to above-the-fold elements so an experiment isolates below-the-fold effects.
Flicker-Free Testing
A technical setup that prevents users from briefly seeing the original page before a test variant loads.
Orthogonal Test Design
A test structure where multiple variables are changed independently so their individual effects can be measured without interference.
See this in the wild
ABWatcher watches how top teams apply uplift.
Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.