Boost your content ROI!

It's time to get creative! Transform your content marketing strategy and
boost your content ROI with our free guide #ContentMonth

Free members guide
Explore our Digital Marketing Strategy and Planning Toolkit

Have you tried this CRO testing method?

Chart of the day: Most marketers are not using Bandit, a CRO testing method.

Most marketers are doing A/B testing, whilst Multivariate testing and Bandit testing, are less used. 

What are the differences between each method?

A/B testing involves testing two versions of a page. There is a challenger and a control (usually the original page if you’re testing a different version against an existing page). Visitors are randomly assigned a version. Tests usually continue until a page (or version) is statistically (and significantly) better than the other.

Multivariate testing (MVT) is very similar to A/B testing but involves testing more than two versions

Bandit is similar to MVT except, increased traffic is sent to the most successful option, rather than sending equal numbers of visitors to each version. This allows you to increase conversions in line with the most successful methods during the test, rather than waiting until the end of the test to shift traffic to the most successful page. It also means that if suddenly another page starts performing better, you can suddenly shift traffic to that one. With bandit testing, traffic may also be sent to more than two versions like MVT.

The diagram below by Crazyegg shows the difference between Bandit and AB testing.

Which method should you use?

It depends on what your testing and for how long.

A/B testing is the most popular method as shown above, it’s also very easy to setup and manage.

Bandit testing is best off used instead of MVT, as it’s similar to MVT but with the added protection that whichever version is winning and most successful, you can direct traffic to this version and hopefully increase conversions quicker.

Is testing structured in other businesses?

According to the Conversion Rate Optimization (CRO) report by ConversionXL, most marketers follow a Conversion rate optimization process

However, just under 4 in 10 (39%) say it isn’t structured or documented, but 36% say it is.

Most optimization, according to a CRO report by ConversionXL, also reveals that most CRO is conducted by one person in the company.

By Robert Jones

Robert Jones is a specialist in Insight, UX Research, Digital and Content Marketing. He has a Psychology Masters of Research, has built research panels and worked in insight roles for Vision Critical, ASDA and WhatUsersDo. He also managed all of Smart Insights member resources and published several guides such as "How to conduct Persona Research" as well as contributing over 100 blog posts to the Smart Insights blog. You can connect with Robert on LinkedIn or follow him on Twitter

This blog post has been tagged with:

Conversion Rate Optimisation (CRO)ux

Start the discussion on our community and social networks

Turbocharge your results with our

Digital marketing strategy and planning Toolkit

Get FREE marketing planning templates

Start your Digital Marketing Plan today with our free Basic membership.

  • FREE fast start guides to review your approach
  • FREE digital marketing plan templates
  • FREE alerts on the latest developments

Need help with your Digital marketing strategy?

Get more from your digital marketing with in-company or remote training and consultancy from Smart Insights

Get FREE marketing planning templates

Start your Digital Marketing Plan today with our free Basic membership.

  • FREE fast start guides to review your approach
  • FREE digital marketing plan templates
  • FREE alerts on the latest developments

Recommended Blog Posts

Popular Blog Posts