Improving Paid Media Effectiveness
Explore the latest paid media options in our Facebook and Google cheatsheet #PaidMediaMonthFree members guide
Most marketers are doing A/B testing, whilst Multivariate testing and Bandit testing, are less used.
A/B testing involves testing two versions of a page. There is a challenger and a control (usually the original page if you’re testing a different version against an existing page). Visitors are randomly assigned a version. Tests usually continue until a page (or version) is statistically (and significantly) better than the other.
Multivariate testing (MVT) is very similar to A/B testing but involves testing more than two versions
Bandit is similar to MVT except, increased traffic is sent to the most successful option, rather than sending equal numbers of visitors to each version. This allows you to increase conversions in line with the most successful methods during the test, rather than waiting until the end of the test to shift traffic to the most successful page. It also means that if suddenly another page starts performing better, you can suddenly shift traffic to that one. With bandit testing, traffic may also be sent to more than two versions like MVT.
The diagram below by Crazyegg shows the difference between Bandit and AB testing.
It depends on what your testing and for how long.
A/B testing is the most popular method as shown above, it’s also very easy to setup and manage.
Bandit testing is best off used instead of MVT, as it’s similar to MVT but with the added protection that whichever version is winning and most successful, you can direct traffic to this version and hopefully increase conversions quicker.
According to the Conversion Rate Optimization (CRO) report by ConversionXL, most marketers follow a Conversion rate optimization process
However, just under 4 in 10 (39%) say it isn’t structured or documented, but 36% say it is.
Most optimization, according to a CRO report by ConversionXL, also reveals that most CRO is conducted by one person in the company.
By Robert Jones
Robert is Senior Research and Content Coordinator at Smart Insights, he manages all member resource updates, recruiting and liaising with expert digital marketing authors. He produces our partner research reports and he is a member of the Market Research Society (MRS). Robert has over 6 years experience in Insight, UX and digital marketing campaigns. You can connect with Robert on LinkedIn or follow him on Twitter
Start the discussion on our community and social networks
Recommended Blog Posts
When you operate an ecommerce store; you’re either losing or making money. Sales are either up or down. Whatever your situation, you can always increase your store’s conversions to stop the bleeding or make even more money One of the …..
Shockingly, 94% of respondents aren’t ready for GDPR With the new GDPR changes being implemented in May, it is a hot topic on every marketer’s mind. The change in regulations will affect the way companies can retrieve, use and store …..
Popular Blog Posts
Statistics on consumer mobile usage and adoption to inform your mobile marketing strategy mobile site design and app development “Mobile to overtake fixed Internet access by 2014” was the huge headline summarising the bold prediction from 2008 by Mary Meeker, an …..
Amazon’s business strategy, revenue model and culture of metrics: a history I’ve used Amazon as a case study in my books for nearly 20 years now since I think all types of businesses can learn from their digital business strategy. From startups …..
Landing page examples and best practice advice Discussion of web design in companies who don’t know the power of landing pages still often focuses on the home page. But savvy companies know that custom landing pages are essential to maximise conversion …..