# www.robotstxt.org # code.google.com/web/controlcrawlindex User-Agent: * Disallow: /cache/ Disallow: /cgi-bin/ Disallow: /core/ Disallow: /jack/ Disallow: /m/ Disallow: /minify/ Disallow: /settings/ Disallow: /webstat/ Allow: /sitemap.xml