CRO Glossary
Above-and-Beyond Metric
A secondary success metric tracked beyond the primary KPI to reveal whether a win comes at a hidden cost elsewhere.
When you run a test, the primary metric tells you whether the thing you optimized for moved — but it doesn't tell you what else changed. An above-and-beyond metric is any additional measure you track deliberately to catch side effects that wouldn't otherwise be visible in the headline result. It's a mindset as much as a specific number: always ask what a variant could be trading off to win.
This matters because conversion rate optimization is full of local maxima that hurt the business globally. A checkout redesign might lift add-to-cart rate while quietly increasing returns, support tickets, or churn a month later. Without watching for that, teams ship changes that look like wins in the dashboard but erode revenue or trust over time.
For example, a subscription site tests a more aggressive discount banner and sees signups jump 12%. Tracking revenue per visitor and 30-day retention as above-and-beyond metrics reveals that the new signups are lower-quality and churn faster, making the '12% lift' a net negative. Teams that build in this habit tend to catch these problems before a full rollout rather than after.
In practice, above-and-beyond metrics are chosen at experiment design time, alongside the primary metric and guardrails, so the team isn't scrambling to explain a surprising result after the fact.
Related terms
Shrinkage Estimator
A statistical adjustment that pulls noisy per-variant or per-segment estimates toward an overall average to reduce overfitting to randomness.
Flicker Test
A diagnostic check to confirm whether users briefly see the original page before a variant renders in client-side experiments.
Pre-Experiment Bucketing Audit
A review process confirming users are being randomly and evenly assigned to experiment variants before launch.
Above-Fold Exclusion Rule
A test-design rule that deliberately prevents changes to above-the-fold elements so an experiment isolates below-the-fold effects.
Flicker-Free Testing
A technical setup that prevents users from briefly seeing the original page before a test variant loads.
Orthogonal Test Design
A test structure where multiple variables are changed independently so their individual effects can be measured without interference.
See this in the wild
ABWatcher watches how top teams apply above-and-beyond metric.
Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.