CRO Glossary
Decision Velocity
The speed at which a team turns experiment results into a shipped decision, separate from how fast tests run.
Decision velocity measures the lag between an experiment reaching a conclusive result and the organization actually acting on it — shipping the winner, killing the loser, or iterating. It's a different bottleneck than test duration or experiment velocity: a test can finish quickly but sit in a backlog for weeks waiting on stakeholder sign-off, legal review, or a sprint slot.
This matters because a slow decision cycle erodes the entire value of experimentation. If a winning variant sits unshipped for a month, that's a month of lost incremental conversion, and it also demoralizes teams who start to see testing as busywork rather than a lever for real change.
As an example, a growth team might run a pricing page test that hits significance in 12 days, but the winning variant isn't shipped for another six weeks because it requires sign-off from three different stakeholders — that 6-week gap is the decision velocity problem, independent of how well the experiment itself was run.
Teams that actively manage decision velocity often pre-agree on shipping criteria and owners before a test launches, so the moment results are in, there's no ambiguity about who approves the rollout.
Related terms
Shrinkage Estimator
A statistical adjustment that pulls noisy per-variant or per-segment estimates toward an overall average to reduce overfitting to randomness.
Flicker Test
A diagnostic check to confirm whether users briefly see the original page before a variant renders in client-side experiments.
Pre-Experiment Bucketing Audit
A review process confirming users are being randomly and evenly assigned to experiment variants before launch.
Above-Fold Exclusion Rule
A test-design rule that deliberately prevents changes to above-the-fold elements so an experiment isolates below-the-fold effects.
Flicker-Free Testing
A technical setup that prevents users from briefly seeing the original page before a test variant loads.
Orthogonal Test Design
A test structure where multiple variables are changed independently so their individual effects can be measured without interference.
See this in the wild
ABWatcher watches how top teams apply decision velocity.
Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.