CRO Glossary
Qualitative Research
Non-numerical research methods, like user interviews and session recordings, used to understand why users behave the way they do.
Qualitative research covers methods such as user interviews, usability testing sessions, open-ended survey responses, and session recordings or heatmaps. Unlike A/B testing, which tells you what happened (variant B converted better than variant A), qualitative research aims to explain why — what confused users, what made them hesitate, what language resonated. It's usually the source of hypotheses that later get validated quantitatively.
A mature experimentation program treats qualitative and quantitative research as complementary rather than competing: qualitative work generates and explains hypotheses, while structured testing measures whether a proposed fix actually moves the needle at scale. Relying on qualitative research alone risks acting on a vocal minority's opinions; relying on quantitative data alone risks optimizing a metric without understanding the underlying user experience.
Example: session recordings show users repeatedly clicking on a product image expecting it to zoom, then abandoning the page when it doesn't respond. That observation becomes the hypothesis for an A/B test adding image zoom functionality, and the subsequent test measures whether the fix actually improves conversion rate.
Related terms
Shrinkage Estimator
A statistical adjustment that pulls noisy per-variant or per-segment estimates toward an overall average to reduce overfitting to randomness.
Flicker Test
A diagnostic check to confirm whether users briefly see the original page before a variant renders in client-side experiments.
Pre-Experiment Bucketing Audit
A review process confirming users are being randomly and evenly assigned to experiment variants before launch.
Above-Fold Exclusion Rule
A test-design rule that deliberately prevents changes to above-the-fold elements so an experiment isolates below-the-fold effects.
Flicker-Free Testing
A technical setup that prevents users from briefly seeing the original page before a test variant loads.
Orthogonal Test Design
A test structure where multiple variables are changed independently so their individual effects can be measured without interference.
See this in the wild
ABWatcher watches how top teams apply qualitative research.
Live A/B tests at 1,000+ high-converting brands, with plain-English hypothesis and takeaway.