CRO Glossary
Ramp-Up
Gradually increasing the percentage of traffic exposed to a new variant rather than launching it to 100% of users at once.
Ramp-up is a risk-management technique where a new experience is rolled out to a small slice of traffic first (say 1-5%), monitored for problems, and then gradually increased toward full traffic allocation if guardrails hold. It's especially common when shipping a change via a feature flag, since flags make it trivial to dial exposure up or down without a new deploy.
The main purpose is to limit blast radius: if a variant has a bug, a broken checkout step, or an unexpectedly severe negative effect on a guardrail metric, catching it at 2% of traffic is far cheaper than discovering it at 100%. Ramp-up is also used after a test declares a winner, to de-risk the full rollout even after the statistical decision has already been made.
A subtlety worth watching for is that a fast, uneven ramp-up schedule can itself introduce statistical noise or timing confounds into an analysis if the traffic split changes mid-experiment — for this reason many teams keep allocation fixed for the official test period and only ramp up after the test has concluded and a decision has been made.
Related terms
Shrinkage Estimator
A statistical adjustment that pulls noisy per-variant or per-segment estimates toward an overall average to reduce overfitting to randomness.
Flicker Test
A diagnostic check to confirm whether users briefly see the original page before a variant renders in client-side experiments.
Pre-Experiment Bucketing Audit
A review process confirming users are being randomly and evenly assigned to experiment variants before launch.
Above-Fold Exclusion Rule
A test-design rule that deliberately prevents changes to above-the-fold elements so an experiment isolates below-the-fold effects.
Flicker-Free Testing
A technical setup that prevents users from briefly seeing the original page before a test variant loads.
Orthogonal Test Design
A test structure where multiple variables are changed independently so their individual effects can be measured without interference.
See this in the wild
ABWatcher watches how top teams apply ramp-up.
Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.