Blogging Tips no image

Published on August 18th, 2011 | by Olawale Daniel


What are A/B Testing and Multivariate Testing and how to use them

Ok, so you have a blog or an online store or some other form of website and it makes a little money, or maybe it makes a lot. Many of us in this position get fixated with trying to drive more traffic to our sites so we can keep growing our earnings. Whilst there is nothing wrong with this it’s worth remembering the simple equation of visitors multiplied by conversion rate (it’s not quite this simple as thing like basket size have an impact too) will go a long way to determining how much your site makes. Despite this many website owners focus nearly all of the time on traffic generation and none or very little on improving conversion rates.

Credit: deathtiny42

What Is The Conversion Rate?

Websites, like any other store, have visitors, a portion of whom become customers. Website owners can measure the number of visitors that are converted into customers by using a metric called the conversion rate. This is a variable expressed as a percentage, arrived at by dividing the number of customers into the number of visitors. The conversion rate tells the website owner how efficiently he is running his business. A high conversion rate can sustain an online business against fluctuating levels of Internet traffic. Improving this rate is critical to profitability and staying competitive.

A/B and Multivariate Testing

To raise the conversion rate, a website owner has to determine how he can change his site to persuade more visitors to complete a certain action. This action is the goal of the site, whether it is buying a product, ordering a service, signing up for a newsletter, taking a survey or some other action. It is possible to quantitatively test the site to discover precisely how these goals can be better met. Two popular methods are used to great effect when trying to take a site to the next level: A/B and multivariate testing.

A/B testing, also known as split testing, is the simpler method of the two. The site owner starts by focusing on a single element on one of his web pages. Items that can be tested may include images, headers, colors, text, footers, call-to-action buttons, graphics, size, position, layout and theme. A/B testing takes a single component and splits it into two variations. The first is left unchanged and used as a control. The second is changed in some way. Both versions are shown to an equal number of visitors simultaneously. Whichever version has the higher conversion rate wins.

Multivariate testing is much more sophisticated and has the potential to produce better results. This testing method is capable of taking several components, combining them into multiple variations and showing them all to visitors at once. This is far more accurate than A/B testing, since multivariate testing can conclusively demonstrate that a particular combination of variations is more popular with visitors. A/B testing, on the other hand, is limited by the fact that it focuses on one element at a time. Multivariate testing produces results that can be more readily verified as statistically significant.

Using Them Effectively

The best way to create and implement both A/B and multivariate tests is to use a tool like Google Website Optimizer. The results from A/B testing are less readily verifiable than multivariate results, but a good testing tool will be able to come up with reliable indicators. Multivariate testing has well-defined conditions that can inhibit the testing results. A low traffic volume distorts the results, while high performance shifts between variations can also decrease their effectiveness. A low conversion rate, somewhat of a catch-22, also biases the results. The higher the rate and traffic volume, while having low performance changes, produces the most reliable results.

Given that Google’s Website Optimizer is free and easy to use there’s not good reason not to run A/B and multivariate tests for your site. It could be the easiest way to grow your site’s profitability. You can read up further at Maxymiser on how multivariate testing works plus other forms of split testing.


This is a guest post by Paul who writes for Maxymizer.

You can also write for techatlast by visiting our write for us page or you can also get in touch with us through the contact us page.


Tags: , , , ,

About the Author

Olawale Daniel is a Business Psychologist and Efficiency Expert with little-to-no-coding experience, but he knows how to run into trouble while coding! Follow Olawale on Twitter | Google+. TechAtLast is a blog for latest technology trends, events reporting with tutorials, hacks, guides and support for internet users. For advert placement, check our Advertisers page here to build audience for your business. You can as well order Sponsored Product Reviews here for your start-ups and established businesses. Follow on | Facebook | Twitter | Google+ | Pinterest

12 Responses to What are A/B Testing and Multivariate Testing and how to use them

  1. Ikenna says:

    I agree with testing using different methods and variations. Some times more traffic is not what we need to make more money but experimentation.
    Nice post.

  2. voip service says:

    Thanks for sharing the post, it will also help me to increase the conversion rate of my ppc campaigns.

  3. Brent says:

    Hi Olawale,

    I agree with you here. In order to reach the success through online, we must experiment and explore to find the best formula in online marketing success.

    • Yeah! You need to test what you are getting from your campaign in order to know where to focus on better than to be doing what will not bring good results at all.
      Thanks for the comment :)

  4. Social Blog says:

    One thing that i learned about conversion rate is that the load time and user friendly interface helps turning visitors into customer. So just like SEO or Social Media marketing, Site performance is also important. any ways thanks Daniel for the info

Leave a Reply

Your email address will not be published. Required fields are marked *

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Back to Top ↑

Do You Want to Get TOP-NOTCH Tech Stuffs into your email?

Enter your active email to get industry leading technology updates into your inbox every MONDAY of the week!

PS: Your information is secure with us, we will never rent your details. That's our promise!