Search Engine Optimisation (SEO) for Applebot

Submitted by dryer on Thu, 06/16/2016 - 19:14

Apple is hard at work for making it's entry to the Search industry. It's crawler, AppleBot is now scouring the web for results and you may have seen this in your server logs:

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1; +


SEO is harder than ever before

Submitted by dryer on Sat, 03/12/2016 - 17:44

Search Engine Optimisation (SEO) used to be quite easy. Essentially you just had to be aware of how Google works on a high level and make sure you had a few key things done right and you could be fairly confortable that you were getting results. It was especially easy for SEO consultants to shine because of much of the competition in some industries was still a bunch of sleeping beauties.

3rd Party domain Robots.txt blocking JavaScript, CSS - Limited indexing and Google Search Console warnings

Submitted by dryer on Wed, 07/29/2015 - 19:11

Google has sent warnings about about subpar results for search indexing if your robots.txt blocks CSS or JS. GoogleBot is very capable at excecuting JavaScript nowadays, so the reason for this is clear.

If you've got dynamic content generated by JavaScript (which is blocked) then GoogleBot will respect the robots.txt block and thus will not be able to display content: