User-agent: * # directed to all spiders Disallow: /cgi-bin/sources Disallow: /stats/ Disallow: /admin/ Disallow: /support/