AB and multivariate testing

Best practice in creating structured experiments to improve page designs by varying different elements and comparing against an original.

Our Quick Guide to ab and multivariate testing...

What is ab and multivariate testing?

Multivariate testing enables simultaneous testing pages for all combinations and variations of page elements that are being tested. These enables selection of the most effective combination of design elements to achieve the desired goal.

This contrasts with AB Testing where, in its simplest form A/B testing refers to testing two different versions of a page or a page element such as a heading, image or button. The alternatives are served alternately with the the visitors to the page randomly split between the two pages. Hence it is sometimes called ‘live split testing’.

Blog posts

Principles and best practice in Multivariate website testing
Dave Chaffey, June 22, 2008

Many companies are now turning to Multivariate and AB Testing to meet their goals, typically increased conversion rates or revenue per visit. Use of multivariate and AB testing is certainly going to increase with the Google Website Optimizer recently coming out of beta (see below). To find out more about best practice and future trends in these testing techniques I recently talked to Mark Simpson, Managing Director of Maxymiser, a UK-based supplier of advanced Multivariate testing tools…

AB and multivariate testing Read more
More advice

Best websites on ab and multivariate testing

You may also find useful Avinash Kaushik’s overview of the advantages and disadvantages of website design testing alternatives and other great tips on where to start with improving website design effectiveness.

Tools and Software

One of the best compilations comparing MVT tools is WhichMVT.

If you’re thinking of using the Google Website optimiser tool, for tips see these articles from GrokDotcom:


Please let us know your comments on our Quick Guide to ab and multivariate testing. Tell us what you like, don't like or other ideas of what it should include. Thanks!

Feedback Form
Feedback Form