############################### # # # address all robots by using wild card * # # If you wish to address individual robots you need to list each robot separately # with an individual User-agent: statement. # They must be listed by their specific name or IP Address, # along with a separate Disallow: / statement listing the folders and # files you DO NOT want the specified robot to index. # User-agent: * # # list folders robots are not allowed to index # This command tells all robots not to index anything on the site. # Disallow: / # # End of robots.txt file # ###############################