# For more information about the robots.txt standard, see: # http://www.robotstxt.org/wc/robots.html # # For syntax checking, see: # http://www.sxw.org.uk/computing/robots/check.html # Let in google mini (restriction are in mini itself User-agent: gsa-crawler Crawl-delay: 10 Disallow: # keep all other robots out User-agent: * Disallow: /