CRO Glossary
North Star Metric
The single metric a team optimizes above all others because it best captures long-term value delivered to users and the business.
A North Star metric is the one number an experimentation program rallies around when a test moves several metrics in different directions. It should represent genuine long-term value, not just an easy-to-move proxy — for example, 'weekly active users completing a core action' rather than raw signups, since signups alone can be inflated without real engagement.
North Star metrics matter in CRO because tests very often show tradeoffs: a more aggressive urgency banner might lift immediate conversions but hurt trust and long-term retention. Having an agreed North Star, backed by supporting guardrail metrics, gives teams a tiebreaker rule instead of relitigating priorities on every experiment readout.
For an e-commerce company, the North Star might be repeat purchase rate rather than single-session conversion rate; for a SaaS product, it might be activated accounts reaching a usage threshold rather than raw trial signups. The key discipline is resisting the urge to change the North Star every quarter just because a test doesn't move it favorably.
Related terms
Shrinkage Estimator
A statistical adjustment that pulls noisy per-variant or per-segment estimates toward an overall average to reduce overfitting to randomness.
Flicker Test
A diagnostic check to confirm whether users briefly see the original page before a variant renders in client-side experiments.
Pre-Experiment Bucketing Audit
A review process confirming users are being randomly and evenly assigned to experiment variants before launch.
Above-Fold Exclusion Rule
A test-design rule that deliberately prevents changes to above-the-fold elements so an experiment isolates below-the-fold effects.
Flicker-Free Testing
A technical setup that prevents users from briefly seeing the original page before a test variant loads.
Orthogonal Test Design
A test structure where multiple variables are changed independently so their individual effects can be measured without interference.
See this in the wild
ABWatcher watches how top teams apply north star metric.
Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.