The ABWatcher blog · Page 20
More live A/B tests
Aiko Tanaka
How to Set Up Statistical Significance in A/B Testing: A Complete Guide
A beginner-friendly guide to statistical significance, p-values, and confidence intervals — what they actually mean, and how to avoid the mistakes that quietly invalidate most A/B tests.
Jul 21, 2026

Aiko Tanaka
Attio's A/B Test: Killing Enterprise Pricing and Leading with Tweets
Attio is running a live A/B test on its AI CRM landing page, swapping a left-aligned 4-tier pricing layout for a centered hero, social proof, and a simplified 3-tier table.
Jul 21, 2026
Sam Lee
Regression to the Mean: Why Your A/B Test Winner Fades After Launch
Winning variants often lose 20-50% of their measured lift post-launch. Here's the statistics behind regression to the mean and a framework for monitoring what's real.
Jul 20, 2026

Sam Lee
Attio Is A/B Testing Its Entire Funnel Narrative, Not Just Its Hero
Attio's live test pits a simple 3-card overview against a narrative, accordion-style page with a 4th Enterprise tier. Here's the math on why this is a real structural bet, not a button-color test.
Jul 20, 2026
Maya Patel
Cohort Analysis in A/B Testing: Finding Out Why a Variant Wins
A practical guide to segmenting A/B test results by signup date, traffic source, and device — so you understand why a variant wins, not just that it did.
Jul 19, 2026

Maya Patel
Sentry's APM Landing Page Tests Tabs vs. Accordion for Feature Discovery
Sentry is A/B testing a horizontal tab navigation against a vertical accordion on its APM landing page — a classic scan-vs-explore tradeoff worth studying before your next layout test.
Jul 19, 2026
Jordan Reeves
The Psychology of CTA Button Color: Why Your Blue Button Might Not Convert Better
Button color rarely moves conversion on its own — contrast, copy, and context do the heavy lifting. Here's what actually matters when you're deciding what to test this sprint.
Jul 18, 2026

Jordan Reeves
Brunt Workwear's 'Shop by Toe' Test: When Guided Nav Beats a Clean Homepage
Brunt Workwear is A/B testing a 'Shop by Toe' category section on its homepage. Here's what the variant reveals about guided navigation vs. minimalism.
Jul 18, 2026

Diego Hernandez
Upwork Is A/B Testing Its Own Identity Crisis on the Homepage
Upwork is running a hero test that pits "AI-productivity" positioning against classic marketplace framing — and the pricing section changes with it. Here's what we caught.
Jul 17, 2026
Aiko Tanaka
Segmentation in A/B Testing: Why One Winner Loses for Half Your Audience
Aggregate A/B test results hide the fact that winners often flip by segment. Here's how to structure segmented analysis so you ship the right variant to the right cohort.
Jul 16, 2026

Aiko Tanaka
Mailmodo Is A/B Testing Its Own Homepage Length — On Itself
Mailmodo, an email A/B testing company, is running a live Optimizely test on its own homepage — pitting a lean single-hero page against a long-form, feature-stacked one.
Jul 16, 2026
Sam Lee
Multivariate Testing vs. A/B Testing: Which Should You Run First
A decision framework for when to run A/B tests vs. multivariate tests, with the sample size math and interaction effects that determine which one actually gets you a valid answer.
Jul 15, 2026