The Complete Guide to A/B Testing
What is A/B Testing?
A/B testing (sometimes called split testing) is comparing two versions of a web page to see which one performs better. You compare two web pages by showing the two variants (let’s call them A and B) to similar visitors at the same time. The one that gives a better conversion rate, wins!
All websites on the web have a goal – a reason for them to exist
- eCommerce websites want visitors buying products
- SaaS web apps want visitors signing up for a trial and converting to paid visitors
- News and media websites want readers to click on ads or sign up for paid subscriptions
Every business website wants visitors converting from just visitors to something else. The rate at which a website is able to do this is its “conversion rate”. Measuring the performance of a variation (A or B) means measuring the rate at which it converts visitors to goal achievers.
Why Should You A/B Test?
A/B testing allows you to make more out of your existing traffic. While the cost of acquiring paid traffic can be huge, the cost of increasing your conversions is minimal. To compare, a Small Business Plan of Visual Website Optimizer starts at $49. That’s the cost of 5 to 10 Google Adwords clicks. The Return On Investment of A/B testing can be massive, as even small changes on a landing page or website can result in significant increases in leads generated, sales and revenue.
What Can You Test?
Almost anything on your website that affects visitor behavior can be A/B tested.
- Sub headlines
- Paragraph Text
- Call to Action text
- Call to Action Button
- Content near the fold
- Social proof
- Media mentions
- Awards and badges
Advanced tests can include pricing structures, sales promotions, free trial lengths, navigation and UX experiences, free or paid delivery, and more.
A/B Testing and SEO
Google cleared the air on the SEO implications of A/B testing in their blog post titled “Website Testing And Google Search “. The important bits from that post are:
Cloaking – showing one set of content to humans, and a different set to Googlebot – is against our Webmaster Guidelines, whether you’re running a test or not. Make sure that you’re not deciding whether to serve the test, or which content variant to serve, based on user-agent. An example of this would be always serving the original content when you see the user-agent “Googlebot.” Remember that infringing our Guidelines can get your site demoted or removed from Google search results – probably not the desired outcome of your test.
Use 302s, not 301s.
Only run the experiment as long as necessary
The amount of time required for a reliable test will vary depending on factors like your conversion rates, and how much traffic your website gets; a good testing tool should tell you when you’ve gathered enough data to draw a reliable conclusion. Once you’ve concluded the test, you should update your site with the desired content variation(s) and remove all elements of the test as soon as possible, such as alternate URLs or testing scripts and markup.
A/B Testing Process
The correct way to run an A/B testing experiment is to follow a scientific process. It includes the following steps:
- Study your Website Data: Use a website analytics tool such as Google Analytics, and find the problem areas in your conversion funnel. For example, you can identify the pages with the highest bounce rate. Let’s say, your homepage has an unusually high bounce rate.
- Observe User Behavior: Utilize visitor behavior analysis tools such as Heatmaps. Visitor Recordings. Form Analysis and On-page Surveys. and find what is stopping the visitors from converting. For example, “The CTA button is not prominent on the home page.”
- Construct a Hypothesis: Per the insights from visitor behavior analysis tools, build a hypothesis aimed at increasing conversions. For example, “Increasing the size of the CTA button will make it more prominent and will increase conversions.”
- Test your Hypothesis: Create a variation per your hypothesis, and A/B test it against the original page. For example, “A/B test your original home page against a version that has a larger CTA button.” Calculate the test duration with respect to the number of your monthly visitors, current conversion rate, and the expected change in the conversion rate. (Use our Bayesian Calculator here. )
- Analyze Test Data and Draw Conclusions: Analyze the A/B test results, and see which variation delivered the highest conversions. If there is a clear winner among the variations, go ahead with its implementation. If the test remains inconclusive, go back to step number three and rework your hypothesis.
- Report results to all concerned: Let others in Marketing, IT, and UI/UX know of the test results and the insights generated.
Your First A/B Test
Starting conversion optimization with Visual Website Optimizer is incredibly easy. Essentially, it is just four simple steps.
1. Include the Visual Website Optimizer code snippet in your website
Including the code snippet means we are now ready to run the tests you create on your website. For further ease, we have plugins for WordPress. Drupal and Joomla that make the process hassle free.
2. Create variations using the WYSIWYG Visual Editor
Load your website in the Visual Editor and create any changes using the simple point-and-click interface. Advanced users can even make CSS and JS code changes.
3. Choose your goals
All A/B tests have goals whose conversion rate you want to increase. These goals can be straight forward (clicks on links, visits page) or could use advanced custom conversion code.
4. Start and track your test
And that’s it, your test is ready to go live. Reporting is real-time so you can start seeing reports as soon as visitors arrive on a live test.
A/B Testing Success Examples
Hands on: Amazon Kindle Touch (2016) eBook reader #technology #news, #gadgets #on #the #go,
Hands on: Amazon Kindle Touch (2016) eBook reader
It’s missing most bells and whistles, but the addition of Bluetooth opens up Amazon’s new entry-level Kindle Touch to vision-impaired book lovers.
While the high-end Kindles keep getting more and more expensive, like the $299 Kindle Voyage and $449 Kindle Oasis. Amazon hasn’t forgotten that we can’t all justify spending hundreds of dollars on an eBook reader. The new $109 entry-level model retains the same price tag as its predecessor and offers little in the way of improvements, making sure it remains good value for money for book lovers on a tight budget.
Having only reviewed the premium model Kindles over the last few years, I have to say I was underwhelmed when I first took the new budget model out of the box. Compared to the Voyage and Oasis it feels like cheap lightweight plastic, as if Amazon has gone out of its way to make this feel like the el cheapo model.
Of course technology moves quickly and I realise that only a few years ago I would have called this design a marvel of the age. It’s actually 11 per cent thinner and 16 per cent lighter than its predecessor, although the decision to go with fat rounded edges makes it feel more bloated than it really is.
I’m sure the new Kindle would make a much better first impression if you weren’t familiar with the top shelf Kindles, but it’s something to keep in mind if you know your way around the Kindle range.
While it has a slightly smaller footprint than its predecessor, the new budget model retains the same 6-inch screen offering 167 pixel per inch resolution. All of the other Kindles offer 300 ppi resolution, with crisp text that looks like it was spat out by a laser printer, but I wouldn’t consider this a deal-breaker if you’re just reading novels.
The budget model also lacks physical page turn buttons, instead you tap or swipe the screen to turn the page. I don’t view this as a shortcoming either, as a tap feels less intrusive on the reading experience than pressing a button – especially considering how cumbersome the Voyage’s buttons can be.
You will now receive updates from Technology Newsletter
Get the latest news and updates emailed straight to your inbox.
The new model is available in a choice of black or white, if you care about aesthetics. Amazon doesn’t throw in a case but sells one as an optional extra for $34.99 with a magnetic clasp which puts the reader to sleep. Unfortunately for fashion-conscious shoppers it seems the case is only available in black.
You also miss out on 3G/4G “Whispernet” access to the Kindle book store while you’re on the road. Even the US model only offers Wi-Fi, but once again I wouldn’t view this as a deal-breaker considering you can either plan ahead or generate a Wi-Fi hotspot from your phone when you’re away from home. Amazon has doubled the onboard storage to 4GB, which should be good for around 3000 eBooks to keep you entertained.
More frustrating is that the entry-level Kindle still lacks the light — a side light shining onto the e-Ink screen, which is easier on your eyes than a backlit LCD screen — which is built into the $179 Kindle Paperwhite and the more expensive models.
The lack of a light won’t bother you if you only tend to read in direct sunlight or under a bright reading lamp, where you’ll appreciate how little glare the Kindle screen throws off. Yet if you find yourself reading in varied lighting conditions then you should really consider the merits of Kindle Paperwhite – especially if you like to read in bed while your partner sleeps.
The new Kindle’s major claim to fame is that it’s the first Kindle e-Ink reader to support Bluetooth audio. You can’t listen to music or audio books, it only lets you take advantage of VoiceView text to speech which reads books aloud and helps you navigate the menus – similar to Apple’s VoiceOver feature design for vision-impaired iGadget owners.
Amazon dropped the headphone jack from its entire Kindle range a while ago, a change which I’m guilty of overlooking in my reviews. If the lack of a headphone jack has kept you from upgrading from a very old Kindle then the new budget model is certainly worth a look.
So what’s the verdict?
If you’re happy with your existing Kindle then there’s no reason to upgrade unless you’re excited about Bluetooth. If you’re looking to buy your first Kindle then I’d certainly think twice about forgoing the backlight which makes the $179 Kindle Paperwhite the sweet spot in terms of price and features.
If you’re certain you can live without the backlight then the new entry-level Kindle could be the perfect addition to your digital bookshelf.
Sell Products Online, Sell Online, Affiliate Marketplace, Sell Products Online With Paypal, Affiliate Marketing,
Sell your products and services through our online marketplace, and let PayDotCom take care of the rest. All while getting paid instantly to your PayPal account. Get an army of affiliates selling your product and getting you massive website traffic.
No Waiting 30 Days to Get Paid: With our patent pending service, you can now get paid instantly to your favorite payment processor like PayPal account.
Promote products in our marketplace and earn commissions as a PayDotCom affiliate. Our members area will allow you to track stats such as clicks, sales, and conversions.
Earn Sales Commissions from 5% to 80% by linking customers to your favorite choice of products and services in the PayDotCom marketplace. Sign up free and start earning commissions today!
Look What People Are Saying About PayDotCom.com
I’ve Now Made Over $2 Million Through PayDotCom.
I gotta tell you when I was planning my million dollar launch I new I needed a payment solution that was Reliable, Risk-free and Robust. There was no real doubt in my mind that PayDotCom would over deliver for me yet again.
I’ve now made over $2 Million through PayDotCom and and totally blown away by the easiness that it all happens. Affiliates get paid, everything gets tracked, my customers get their stuff and everything works as it should. And the best part is I can be up and running in minutes and also reach out to a huge army of proven profit-pulling affiliates.
To find a service like this I would have searched the ends of the earth and paid a small fortune so it’s been my own personal secret that is now leaking out and I just hope you guys keep your prices so ridiculously low (I seriously thought it was a typo error when I saw the tiny fee amount I had to pay on a $1million launch.
When you are dealing with customers’ money, making sure affiliates get credit and being able to rely on a robust service that can handle anything than you use PayDotCom. We did a $849,000 in 3 days and everything went like clockwork. You might be able to tell – I love you guys and you’ve got yet another customer for life here!
– Michael Cheney
Up To The Minute Reports On My Earnings.
– Stephanie L.
Registering my digital information products with PayDotCom.com has proven to be the wisest business decision I have ever made.
The control panel is so easy to use, and within seconds, I can have up-to-the-minute reports on my earnings, my affiliate commissions, as well as the commissions
I owe my own affiliates for sales made through their links. The marketplace is awesome! This system is comprehensive enough for any business to utilize, yet simple enough for the inexperienced internet Newbie to use.
Thanks for providing this awesome alternative for online payment processing! You are the greatest!
PayDotCom Is Way, Way, Way Better.
Just to let you know I’m changing over completely from C—-bank A—PilotRiches, to PayDotCom.com.
My god, you’ve really pulled out the stops. PayDotCom.com is way, way, way better than C—-bank, and any other affiliate market place I’ve seen used. The fact that I can pay my affiliates – and be paid by my merchants – by PayPal is fantastic, no more having to wait for the PayPal check to come over to the UK, and paying about $20 to clear it.
And it’s all so easy so cheap, I am completely unrestricted by any charges, red tape unnecessary steps, which means I can just concentrate on creating marketing products.
Also, the fact that potential affiliates can actually search for my product, rather than just being in a list by popularity, is an enormous advantage, I’m very happy about that!
Thanks so much PayDotCom.com. Keep up the good work!
– Kevin Lewis