# /robots.txt file for http://www.us-cert.gov/ # email webmaster@us-cert.gov for questions # Allow all crawlers, but help them avoid redundant # or unindexable content directories # User-agent: * Disallow: /cgi-bin/ Disallow: /include/