A good question came in video a Google webmaster hangout, in the video at the 21:30 mark the SEO asked if Google has a recommendation around how long A/B tests should run as to not cause issues for Google or the web site in search. The SEO said that some A/B tests require 6+ months of running to get a large enough sample size in order to validate any testing. John Mueller from Google said Google has no specific time period for how long you can run A/B tests. The more important thing is to make sure the content on the A/B testing pages are somewhat equivalent, if they are not, you probably want to run those tests quickly and not extend them too long. Here is the transcription:What period of time and to what percentage of users as Google start to have issues with AB tests? There's some areas of web site where traffic is low so it takes longer to reach a good sample set. That can be up to six months or longer to reach a significant sample set. We don't have a fixed timeline on this. … [Read more...] about Google: No Set Time Periods For A/B Testing Limits
Abs a
Do It Yourself A/B Testing
I always start marketing interviews with a phone screen of some variant of the following question: “Let’s say this is your first day at Urbanspoon and I show you the following data. We’ve just launched an A/B test of that I’d like you to evaluate. [The example can be almost anything you want to test different results for – from almost any search element, PPC campaigns, email subject lines etc. In this case, I’m using a PPC example.] Imagine you are running two different ads on a campaign with 50 kewords. We’ve been running Ad A for a while and have 17,235 impressions and 272 clicks. I started running Ad B last week and that has received 41 clicks on 2,253 impressions. What would you do?” I’m looking for an answer that goes beyond demonstration of pre-algebra skills and rudimentary familiarity with a calculator. Obvious answers include splitting up 50 keywords into different groups, looking down stream to see differences in … [Read more...] about Do It Yourself A/B Testing
5 Targets to Set at the Beginning of an SEO Campaign
Search engine optimization (SEO) is definitely a strategy that depends on planning. What you plan for at the beginning of a campaign can set the tone and effectiveness for your entire execution. Set the wrong goals, or aim for the wrong targets, and you could wind up wasting time and energy pursuing a result that doesn’t align with your original vision (or else, doesn’t earn you a high enough return). If you want to get your SEO campaign started on the right foot, you’re going to need these five targets, at a minimum, guiding your campaign. 1. Audience Choosing an audience isn’t exactly easy. You may already have an idea of who your audience is as a brand—the target demographics who are most likely to buy your product—but when it comes to search, you’ll have to consider a completely separate set of factors. For example, is there a specific segment within your audience more likely to use search than another? Is there a major competitor … [Read more...] about 5 Targets to Set at the Beginning of an SEO Campaign
How a Free Trial A/B test Increased Revenue
There’s romanticism with A/B testing. Like something from a Fabio novel. We’ve all heard the story of the $300 million button, right? You know, the one where adding “checkout as a guest” increased sales by millions of dollars. Ever since you heard about that story, you have been looking for your $300 million change, haven’t you? I have too. I have too. Of all the methods used in conversion rate optimization, A/B testing reigns supreme. For two years straight, the most popular method is A/B testing, followed by copy optimization. And yet, for every great A/B test story you hear, there’s hundreds (or thousands) of failed A/B tests we don’t hear about. I mean, who wants to report a failed test, right? Take a look at the results of this A/B test: That chart tells me one thing; I’m testing the wrong thing and it has zero impact on my conversion rates! Every marketer wants to share that one easy change they made to a website that generated … [Read more...] about How a Free Trial A/B test Increased Revenue
Fiverr: Conquering Conversion with 400 A/B Tests
Meet madmoo. She lives in the United Kingdom. She will find a unique way of visually presenting your copy, be it with coffee, rocks, blocks, magnets or even alphabet-shaped pasta. In a lesser world, finding someone to execute such a niche project could be a herculean task. Thankfully, we do not live in a lesser world. We live in a greater world, where you can hire madmoo — along with thousands of other freelancers specializing in any discipline you can imagine — for just $5. It’s all thanks to Fiverr, a marketplace that connects freelancers with clients in an ingenious way. And they’ve optimized their inbound marketing with the same kind of ingenuity: in less than a year, they’ve gone from 0 to over 400 A/B tests, and have some incredible results to show for it. Read on to find out how one marketer was able to increase the conversion rate of Fiverr’s landing pages by 457% in just ten months. Okay, But Can You Tell Me More about Fiverr First? … [Read more...] about Fiverr: Conquering Conversion with 400 A/B Tests