Meta data comprise details that your particular site visitors are not able to view and they are probably not interested in but they rather serve a function to deliver information intended for search engine robots. ...
You can do this by adding meta robots tags or creating a robots.txt file on your site's root. But for a worpress site, you need not have to worry because there is an excellent plugin called Robots Meta which adds meta robots tags to ...
Initially Spiders give extreme importance to these tags but with the advancement in the algorithms of robots and spiders they become less important but still its important to add them. there are different type of Meta Tags : ...
So there's no need to tag pages with content values of INDEX or FOLLOW. Directing a robots meta tag specifically at Googlebot To provide instruction for all search engines, set the meta name to "ROBOTS". To provide instruction for only ...