# CRELoaded Generated Robots.txt # Robot Exclusion File -- robots.txt # Author: CRELoaded Team # Last Updated : May 11th 2005 # enhancements by Xigen # this will allow everything User-Agent: * Allow: / # Disallow: /admin/ # Disallow: /download/ # Disallow: /includes/ # Disallow: /temp/ # Disallow: /pub/ # Disallow: /templates/ # Disallow: /urchin/