Sample size

Sample size is the number of visitors or conversions each version must see for a test to give a reliable result. It is calculated before the test from the current conversion rate, the size of the difference to be detected and the accepted margin of error. Seeing small differences takes far more traffic.

Why it matters

A test run with few visitors shows large swings that depend on chance. A change made trusting such a result may gain nothing. Sites with little traffic cannot measure small differences. In that case, try bigger changes or run the test for longer.

Example

Say a site has a 2 percent conversion rate and 3,000 visitors a month. Seeing a small rise from 2 to 2.2 percent may need tens of thousands of visitors per version, which takes months. A large change expected to lift the rate from 2 to 3 percent can be measured with far less traffic.

The definitions are general information. If you think one is incomplete or wrong, write to us and we will reply within one working day. Get in touch

From our journal

From what we have written on Data and CRO; they show how the term turns up in the work.

Tell us about
your project.

Fill in the form or write to us directly, and we will agree on a day to talk.

Your first meeting is with Deniz Sezer, founder of Detmore.

First meeting free · Reply within one working day · Written proposal in 2 to 3 days · NDA ready

What do you need? pick as many as you like

Name, email and phone are required.

Contact

We reply within one working day.