User-agent: * Disallow: /logs/ User-agent: googlebot Crawl-delay: 10 User-agent: msnbot Crawl-delay: 10 User-agent: Teoma Crawl-delay: 10 User-agent: Slurp Crawl-delay: 10 User-agent: Lycos Crawl-delay: 10 User-agent: Atomz.com Search Robot Crawl-delay: 10