What is A/B Testing?

Posted by:

Laia Cardona

Hello, nice to see you around here again! :)

If you want to optimize your marketing and make the absolute most of your budget, A/B testing is your secret weapon. It is a very simple and easy-to-use methodology, which only requires a little bit of organization, consistency and discipline. Thanks to these tests, you can improve each element of your marketing campaigns until you are sure you are publishing the perfect content at the perfect time.

A/B testing is an opportunity you simply cannot miss out on. So today we are going to take a look at what exactly these tests are, how to set them up, what to do and what not to do, and even one of our own examples. Let’s get to it!

What is A B testing .png

1# What exactly is an A/B test?

A/B testing is simply the process of testing two variations of any given element in our marketing campaign, comparing their success in order to take conclusions and apply the most successful results. Although it can be used with any type of content, it is typically most popular when designing and launching emailing campaigns and landing pages.

The process is very simple: we create two versions of the same content that differ in only one element, we launch both at the same time and compare which one works better by observing the metrics and results.

1.1# 7 reasons to run A/B tests

  • To increase your profitability. The A/B tests are one of the most accessible and easiest ways to increase your ROI in a short period of time. Thanks to these tests, you can obtain information on what actually works when increasing your conversion. Increase your campaign’s effectivity by incorporating these changes and conclusions to your new campaigns from the very beginning.
  • Controlled innovation. As marketers we know that it’s pretty much innovate or die, but blindly jumping into the unknown can be quite risky. By using a solid A/B testing strategy, you can implement this innovative changes in a controlled and measurable way, using only what you know actually works for your brand.
  • To improve your credibility. There are different elements that you can incorporate into your content to show your users that they can trust you. It may be a simple quality seal from an official organization, a reference to one of the people behind your company, a testimonial… The truth is that different tests work better with different audiences, and A/B testing lets you identify which ones really matter to your audience.
  • To always get the copy right. Copywriting is an art, but systematic testing lets you add a scientific edge to it. Don’t just experiment with you landing page title or email subject: try out different lengths of text, sales arguments or even your tone.
  • To take care of the details that matter. Something as simple as the color of your Call-to-Action button or the size of an image can make a very important difference to your conversions. With the right testing, you can identify and apply the small details that will make your sales grow.
  • To get to know your audience. No two brands are the same… and, as such, no two audiences are the same. The only way to really get to know your target audience is by experimenting. Little by little, you will find a way to win over their hearts and improve both your results and your brand image.
  • To loyalize your clients. Last but not least remember that A B tests are not only for getting your first conversions, but you can also use them in your loyalty strategy. Optimize your marketing to get them to stay with you forever!

1.2# How to run A/B tests with Google Analytics

So you’re convinced - but what now? There are a large variety of A/B testing tools in the market, so you are sure to find one that will fit your needs. To start off, let’s take a look at how to use this kind of testing to improve your conversions with Google Analytics.

With Google Analytics’ Optimize tool, you can easily run a A/B test within your web page, by following these steps:

  • Define your experiment: decide which page you want to test and what is the first element you want to test. Generally, the simplest way to create two versions of the page is by duplicating it and changing only the element you wish to test. You can test an already launched page and a new version, or create a page with two versions from scratch.
  • Establish your experiment’s settings: In Google Analytics, you can configure various aspects of your tests: the goal, the percentage of visitors included in the experiment, the time for which it will be active or even the confidence level of the results.
  • Ready to launch: Once you publish your experiment, visitors will be shown one of your two versions, chosen randomly, and the visitor will never know they are part of a test. If the user returns to the page and has a cookie in their navigator, they will always be shown the same version.
  • Analyze results: As you receive visits, Analytics saves the results. Whenever you are ready, you can check the metrics of both versions and see which one works better. From here on, you can make your decision about keeping or chanin the tested element… and move on to the next test!

1.3# What to do and what not to do

In order to guarantee maximum results, here are some recommendations to follow:

  • Only change one element at a time. When starting to run these tests, we may sometime get ahead of ourselves and want to test everything at once. Creating very different variations, however, is a mistake, as you will not be able to determine what it was that worked better. The best way is to focus on and test one element at a time: the size of the button, the copy, the color…
  • Focus on your key KPIs. There is no point in measuring clicks if your goal is to increase a specific product's sales, for example. A B testing should always be aligned with your marketing goals, and we should always compare the metrics that are most related to them. For example, the conversion of new visitors or repeat purchases.
  • Use your results. After the experiment is over, put it in action! The goal of these A/B tests is to find actionable changes that you can then immediately put into motion. So implement the wining change and continue by testing the next variable, and the next, and the next, until you have the perfect landing page (or email, or ad…).

To stay out of trouble, be sure to avoid these mistakes:

  • Comparing apples and oranges. The groups of users on whom you run these tests must be as alike as possible, or the results won’t actually mean anything. There is no point in targeting each change to groups according to which channels they come from, or other significant characteristics.
  • Letting impatience take the reins. For the results of an experiment to be statistically relevant, it should be tested on as big a group as possible. If your webpage doesn’t have too much traffic, that means you should leave both versions active for days of even weeks to obtain reliable data.
  • Not taking risks. A B tests are the perfect place to let your creativity loose and try out new things. Try out your most daring and crazy ideas, you never know what might surprise you!

2# Success Story: how to get the maximum return with Social ads images

To finish off, I would like to share with you one of our own success stories from here at Cyberclick, in which we used A/B testing to publish advertising campaigns on the most effective social networks.

Given the overwhelming amounts of content that is published on social media everyday, getting users to click on our ads is a significant challenge in and of itself, and in order to do it, it is vital to attract the users attention with a powerful image.


For our test, we launched a series of Social Ads with images that had two variations: one followed the brand’s style guide, while the other was created with a 100% focus on performance. The second batch of images followed certain indications:

  • To use strong contrasts and colors, that stand out from the network’s environment (such as red, orange or yellow).
  • Not to overuse filters, as they reduce the impact of images.
  • To guarantee legibility and control the overlap of visual elements, texts and logos.
  • Include discounts and reduced prices as part of the image, not just in the copy.

The result: the performance-oriented images had 35% higher CTRs and more than doubled the ROI in terms of sales and income. Now, when we recommend them to our clients, we know exactly which ones work best.

We hope this article has been useful for you, and has clarified what exactly an A/B test is, its potential and how to run them. We’ll see you later!


Laia Cardona



Digital Marketing Trends 2017 eBook

Tags: Online Marketing & Digital Marketing

What is your opinion? Leave us your comments here!