As an SEO professional, you know that a big part of your job is tracking rankings in the SERPs, as well as that of those of competitors'. I am going to be sharing a way to obtain SERP data and import it to a DataFrame (table / CSV / excel sheet) for analysis, on a large scale, and in an automated way. I will be using the programming language Python, so there will be some coding involved. If you don't know any programming, you can ignore the code snippets below, as you don't need to understand them to follow along. So how exactly are we going to procure the data, and what are we going to do with it? Let's find out. Importing the Data Google's Custom Search Engine is a service that allows you to create your own customized search engine, where you can specify the sites you want crawled and set your own relevancy rules (if you don't set any specific rules, then your custom search engine will essentially search the whole web by default). You can further streamline your … [Read more...] about Analyzing Search Engine Results Pages on a Large Scale using Python
Both Coca-Cola and Pepsico have seen fit to set up redirects on their homepage URLs—a very common practice among commercial websites. Classically, search optimization experts have advised clients that if their sites perform redirects on pages, they should use only server-side redirection, and it should ideally be a 301 redirect in order to ensure that the search engine can index and rank the destination page properly. However, Google is now handling some non-server-side redirects better than search engines once did—should people worry about 301-ing as much? Using these two big-brand competitors, let’s look at how they’ve set up their redirection to see what’s working and what’s not. A "redirect" in the online world is a programming instruction delivered to a system which requests an internet resource, such as a web page or image, and the instruction tells the requesting system to "go elsewhere." For instance, if a web page has moved, a redirect … [Read more...] about The Coke Vs. Pepsi Challenge: Who Redirects Better?