A/B test

An A/B test shows two versions of a page or element in the same period, assigns visitors to them at random and measures which performs better. Random assignment spreads outside effects such as season or campaigns evenly across both sides. The goal and the sample size needed are fixed before the test begins.

Also called
split test
In Turkish
A/B testi

Why it matters

A before-and-after comparison is affected by season, campaigns and news. An A/B test shows both versions at the same time, so it allows more confidence that a difference comes from the change. With changes made without a test, it is impossible to tell whether things got better or worse.

Example

Say a shop tests the button text on a product page. Version A says “Add to basket”, version B says “Buy now”. Half of the visitors see A, half see B. After three weeks A has 150 orders from 5,000 visits and B has 175 from 5,000. The difference is then judged with a significance calculation.

The definitions are general information. If you think one is incomplete or wrong, write to us and we will reply within one working day. Get in touch

From our journal

From what we have written on Data and CRO; they show how the term turns up in the work.

Tell us about
your project.

Fill in the form or write to us directly, and we will agree on a day to talk.

Your first meeting is with Deniz Sezer, founder of Detmore.

First meeting free · Reply within one working day · Written proposal in 2 to 3 days · NDA ready

What do you need? pick as many as you like

Name, email and phone are required.

Contact

We reply within one working day.