I remember back in my school days (many years ago now unfortunately) that Transformers were robots in Disguise! I loved that theme tune and even had the transformers wrist watch!
Well Robots are different things now-a-days! Well certainly in the SEO world.
Search engines use them to crawl and index our content and our spammer friends use them to scrape our content and harvest our email addresses
but do you know how to use Robot Arguments in your HTML pages?
Here’s the top 5 Robot commands every SEO should be aware of…
-
NOINDEX = Do not index content of this page
NOFOLLOW = Do not follow links on this page
NOARCHIVE = Do not create a cached version of this page
NOODP = Do not use the Open Directory (also known as DMOZ) description in SERPs for this website / page
NOSNIPPET = Do not take information from this page for the purpose of a description in SERPs
and here’s a nice little video showing you how to use them!


