Posts
A robots.txt file is to be used to allow or disallow search engine bots to index some specific part of the website. They are used to block website or its internal directories. If you don’t want to hide any directory or page of the website then you don’t need a robots txt file. For security reason you must need to have robots file on your website so that you can protect your website from spam crawlers. More at : -
Top Search Engines and their Robots Name
Subscribe to:
Post Comments (Atom)
0 comments:
Post a Comment