Svenska (Sverige)English (United Kingdom)
Start Webb General Web The statistics have records of several tries to download the file robots.txt, what is that file used for?

The statistics have records of several tries to download the file robots.txt, what is that file used for?

It is the search engines that tries to download this file. A file with that name can be created in the public_html folder to give some instructions to search engines about how to handle the site.

More information about robots.txt can be found at http://www.searchtools.com/robots/robots-txt.html.