# All robots will spider the domain User-agent: * # Disallow directory Disallow: /cgi-bin/ Disallow: /mtg/ Disallow: /menu/ Disallow: /scripts_all/ Disallow: /stats/ Disallow: /go2stats/ Disallow: /ads/ Disallow: /systemlinks/