All terms

CRO Glossary

Test Duration Calculator

A tool that estimates how long an experiment must run to reach a reliable sample size given traffic and baseline conversion rate.

A test duration calculator combines your site's traffic volume, baseline conversion rate, minimum detectable effect, and desired statistical power to output an estimated number of days (or weeks) needed to run an experiment. It's essentially the sample size calculator translated into a timeline, since sample size alone doesn't tell a team when they can stop looking at results.

Practitioners rely on this before launch, not during, because deciding duration mid-test invites peeking and inflates false positive rates. A good estimate also forces a useful conversation: if the calculator says a test needs 11 weeks to detect a 5% lift, the team can decide upfront whether that's worth doing, or whether they should target a bigger change, a higher-traffic page, or a longer-tail metric instead.

For example, a checkout page getting 2,000 visitors a week with a 4% baseline conversion rate might need roughly 6 weeks to reliably detect a 10% relative lift at 80% power. If the roadmap only allows 2 weeks, the team either accepts higher risk of missing real effects or redesigns the test to target a larger, more detectable change.

A common gotcha is treating the calculator's output as a hard promise rather than a planning estimate — actual traffic can dip due to seasonality, holidays, or unrelated site changes, so most teams pad the estimate and monitor progress against it weekly rather than committing to a fixed calendar date.

Related terms

See this in the wild

ABWatcher watches how top teams apply test duration calculator.

Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.