CRO Glossary
Control Group
The unmodified experience shown to a portion of users, used as the baseline against which variants are measured.
The control group is the version of a page, flow, or feature that stays exactly as it currently exists in production. It represents the status quo and gives you a baseline to compare against any variant you're testing. Without a control, you have no way to know whether a change in conversion rate is due to your new idea or simply due to external factors like seasonality, a marketing campaign, or a site-wide outage.
In a typical A/B test, users are split via the randomization unit into a control and one or more treatment groups, with traffic allocation deciding what share sees each. The control isn't necessarily 'no design' — it's whatever currently exists, even if that design was itself the winner of a previous test.
A common mistake is letting the control group's experience quietly change during the test window (a bug fix, a content update) which contaminates the comparison. Keeping the control completely frozen for the test duration is essential for a clean read, and is one of the first things to check when investigating an unexpected result alongside things like SRM.
Related terms
Shrinkage Estimator
A statistical adjustment that pulls noisy per-variant or per-segment estimates toward an overall average to reduce overfitting to randomness.
Flicker Test
A diagnostic check to confirm whether users briefly see the original page before a variant renders in client-side experiments.
Pre-Experiment Bucketing Audit
A review process confirming users are being randomly and evenly assigned to experiment variants before launch.
Above-Fold Exclusion Rule
A test-design rule that deliberately prevents changes to above-the-fold elements so an experiment isolates below-the-fold effects.
Flicker-Free Testing
A technical setup that prevents users from briefly seeing the original page before a test variant loads.
Orthogonal Test Design
A test structure where multiple variables are changed independently so their individual effects can be measured without interference.
See this in the wild
ABWatcher watches how top teams apply control group.
Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.