# robots.txt for http://www..com - this is not required but is friendly if a user reads this file ever. User-agent: * # All Robots read this Disallow: /cgi-bin/ Disallow: /var/www/cgi-bin/ Disallow: /var/www/html/se/web_links Disallow: /html/se/web_links