# robots.txt fuer profitio.net User-Agent: msnbot Crawl-Delay: 20 User-agent: * Disallow: / # E-Mail Sammler raus User-agent: WX_mail/2.000 Disallow: / User-agent: ia_archiver Disallow: / User-agent: EmailCollector Disallow: / User-agent: WhoWhere Disallow: / # Rover is a bad dog User-agent: Roverbot Disallow: / User-agent: ActiveAgent Disallow: / User-agent: EmailSiphon Disallow: / # yahoo disallowed User-agent: Slurp Disallow: / # updated by mac 20062004_12:47