CRO Glossary
Experiment Roadmap
A prioritized, time-phased plan of upcoming A/B tests aligned to business goals and resourcing.
An experiment roadmap is the strategic layer that sits above a raw backlog of test ideas. Where a backlog is just a list of hypotheses waiting to be run, a roadmap sequences them over weeks or quarters, taking into account traffic availability, engineering dependencies, seasonal effects, and how one test's outcome might inform or block another. It turns experimentation from a series of one-off tests into a coherent program tied to company objectives like activation, retention, or revenue per visitor.
Teams care about this because testing capacity is always scarcer than the number of good ideas. A roadmap forces explicit trade-offs: do you run a high-MDE pricing page test this month, or three smaller checkout-flow tests that could compound? It also helps stakeholders see the 'why now' behind each test, which makes it easier to defend resourcing and to avoid duplicate or conflicting experiments running on the same traffic segment at once.
A practical example: a growth team maintains a quarterly roadmap showing Q1 focused on onboarding experiments (since a cohort analysis flagged early drop-off), Q2 shifting to pricing page tests once a redesign ships, and a standing slot each month for a quick-win CRO test sourced from the backlog. The roadmap is reviewed monthly and reshuffled as results come in — a strong winner in onboarding might free up capacity to fast-track a related test that was previously deprioritized.
Related terms
Above vs Below Median Split
A segmentation technique that divides users into two groups at the median of a metric to compare high and low engagers.
Qualitative Feedback Loop
A recurring process of collecting and acting on user comments, session recordings, and survey responses to inform test hypotheses.
Experiment Metadata
The structured record of who, what, when, and how for a test — hypothesis, owner, dates, variants, and metrics used to track and audit it.
Pre-Test Analysis
The upfront work of validating traffic, metrics, and baseline data quality before launching an experiment.
Above-the-Fold vs Below-the-Fold Messaging Hierarchy
How the order and prominence of value-proposition messaging is split between the visible screen and the rest of the page.
Experiment Contamination
When a control or variant group is unintentionally exposed to the other condition, corrupting the comparison.
See this in the wild
ABWatcher watches how top teams apply experiment roadmap.
Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.