What are A/B Testing and Multivariate Testing? How do I implement them in my marketing?

Ok, so you have a blog or an online store or some other form of website and it makes a little money, or maybe it makes a lot. Many of us in this position get fixated with trying to drive more traffic to our sites so we can keep growing our earnings. Whilst there is nothing wrong with this it’s worth remembering the simple equation of visitors multiplied by conversion rate (it’s not quite this simple as thing like basket size have an impact too) will go a long way to determining how much your site makes. Despite this many website owners focus nearly all of the time on traffic generation and none or very little on improving conversion rates.

What Is The Conversion Rate?

Websites, like any other store, have visitors, a portion of whom become customers. Website owners can measure the number of visitors that are converted into customers by using a metric called the conversion rate. This is a variable expressed as a percentage, arrived at by dividing the number of customers into the number of visitors. The conversion rate tells the website owner how efficiently he is running his business. A high conversion rate can sustain an online business against fluctuating levels of Internet traffic. Improving this rate is critical to profitability and staying competitive.

A/B and Multivariate Testing

To raise the conversion rate, a website owner has to determine how he can change his site to persuade more visitors to complete a certain action. This action is the goal of the site, whether it is buying a product, ordering a service, signing up for a newsletter, taking a survey or some other action. It is possible to quantitatively test the site to discover precisely how these goals can be better met. Two popular methods are used to great effect when trying to take a site to the next level: A/B and multivariate testing.

A/B testing, also known as split testing, is the simpler method of the two. The site owner starts by focusing on a single element on one of his web pages. Items that can be tested may include images, headers, colors, text, footers, call-to-action buttons, graphics, size, position, layout and theme. A/B testing takes a single component and splits it into two variations. The first is left unchanged and used as a control. The second is changed in some way. Both versions are shown to an equal number of visitors simultaneously. Whichever version has the higher conversion rate wins.

Multivariate testing is much more sophisticated and has the potential to produce better results. This testing method is capable of taking several components, combining them into multiple variations and showing them all to visitors at once. This is far more accurate than A/B testing, since multivariate testing can conclusively demonstrate that a particular combination of variations is more popular with visitors. A/B testing, on the other hand, is limited by the fact that it focuses on one element at a time. Multivariate testing produces results that can be more readily verified as statistically significant.

Using Them Effectively

The best way to create and implement both A/B and multivariate tests is to use a tool like Google Website Optimizer. The results from A/B testing are less readily verifiable than multivariate results, but a good testing tool will be able to come up with reliable indicators. Multivariate testing has well-defined conditions that can inhibit the testing results. A low traffic volume distorts the results, while high performance shifts between variations can also decrease their effectiveness. A low conversion rate, somewhat of a catch-22, also biases the results. The higher the rate and traffic volume, while having low performance changes, produces the most reliable results.

Given that Google’s Website Optimizer is free and easy to use there’s not good reason not to run A/B and multivariate tests for your site. It could be the easiest way to grow your site’s profitability. You can read up further on how multivariate testing works plus other forms of split testing.






11 responses to “What are A/B Testing and Multivariate Testing? How do I implement them in my marketing?”

  1. Ikenna Avatar

    I agree with testing using different methods and variations. Some times more traffic is not what we need to make more money but experimentation.
    Nice post.

    1. Olawale Daniel Avatar

      Thanks @Ikenna for this awesome comment 🙂

  2. voip service Avatar
    voip service

    Thanks for sharing the post, it will also help me to increase the conversion rate of my ppc campaigns.

    1. Olawale Daniel Avatar

      Thanks too for the comment 🙂

  3. Brent Avatar

    Hi Olawale,

    I agree with you here. In order to reach the success through online, we must experiment and explore to find the best formula in online marketing success.

    1. Olawale Daniel Avatar

      Yeah! You need to test what you are getting from your campaign in order to know where to focus on better than to be doing what will not bring good results at all.
      Thanks for the comment 🙂

  4. Social Blog Avatar
    Social Blog

    One thing that i learned about conversion rate is that the load time and user friendly interface helps turning visitors into customer. So just like SEO or Social Media marketing, Site performance is also important. any ways thanks Daniel for the info

    1. Olawale Daniel Avatar

      Thanks for the comment 🙂

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.