CRO Glossary
Primacy Effect
A temporary underperformance of a new variant caused by existing users' familiarity with the old experience, the opposite of the novelty effect.
The primacy effect describes when returning users initially perform worse with a new design simply because it's unfamiliar and disrupts habits they've built around the old version, not because the new design is actually worse. Over time, as users adjust, the true effect of the change emerges, often more positively than the early data suggested.
This is essentially the mirror image of the novelty effect, where a new variant gets an artificial short-term boost from curiosity. Both effects distort early results and are reasons experimenters run tests long enough, and monitor results over time by user cohort (new vs. returning), rather than calling a winner after a few days.
A concrete example: redesigning primary navigation on a SaaS dashboard often shows a short-term dip in task completion or click-through rate among long-time users who know the old layout by muscle memory. If the team stops the test after three days and sees a negative result, they may kill a genuinely better design. Segmenting by new vs. returning users, or extending the test duration, helps distinguish a true regression from temporary friction caused by change itself.
Related terms
Shrinkage Estimator
A statistical adjustment that pulls noisy per-variant or per-segment estimates toward an overall average to reduce overfitting to randomness.
Flicker Test
A diagnostic check to confirm whether users briefly see the original page before a variant renders in client-side experiments.
Pre-Experiment Bucketing Audit
A review process confirming users are being randomly and evenly assigned to experiment variants before launch.
Above-Fold Exclusion Rule
A test-design rule that deliberately prevents changes to above-the-fold elements so an experiment isolates below-the-fold effects.
Flicker-Free Testing
A technical setup that prevents users from briefly seeing the original page before a test variant loads.
Orthogonal Test Design
A test structure where multiple variables are changed independently so their individual effects can be measured without interference.
See this in the wild
ABWatcher watches how top teams apply primacy effect.
Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.