# Emailsammler ausschließen User-agent: EmailCollector Disallow: / # Massendownloader fernhalten User-agent: wget User-agent: webzip User-agent: webmirror User-agent: webcopy Disallow: / # folgenden Suchmaschinen einzelne Verzeichnisse verbieten User-agent: BotOnParade Disallow: / User-agent: A-Online Search User-agent: ATN_Worldwide User-agent: Arachnophilia User-agent: ArchitextSpider User-agent: FAST User-agent: Scooter User-agent: Die Blinde Kuh User-agent: Crawler V 0.2.1 admin@crawler.de User-agent: CoolBot User-agent: Deweb/1.01 User-agent: grabber User-agent: Eule-Robot User-agent: Arachnoidea User-agent: ArchitextSpider User-agent: KIT-Fireball/2.0 User-agent: IBM_Planetwide User-agent: InfoSeek Sidewinder/0.9 User-agent: Slurp User-agent: LinkWalker User-agent: Lycos_Spider_(T-Rex) User-agent: WebMoose User-agent: Tarantula User-agent: Gulliver/1.3 User-agent: fido/1.0 Harvest/1.4.pl2 User-agent: MegaSheep User-agent: Ultraseek User-agent: whatUseek_winona User-agent: Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com) User-agent: http://www.almaden.ibm.com/cs/crawler [bc5] user-agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) User-agent: Mozilla/4.0 compatible ZyBorg/1.0 (wn-12.zyborg@looksmart.net; http://www.WISEnutbot.com) User-agent: Googlebot/2.1 (+http://www.google.com/bot.html) User-agent: IRLbot/1.0 (+http://irl.cs.tamu.edu/crawler) User-agent: msnbot/0.3 (+http://search.msn.com/msnbot.htm) User-agent: NutchCVS/0.05 (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) Disallow: /account/ Disallow: /admin/ Disallow: /cgi-bin/ Disallow: /framework/ Disallow: /images/ Disallow: /include/ Disallow: /install/ Disallow: /kunde-index1/ Disallow: /languages/ Disallow: /media/ Disallow: /modules/ Disallow: /phpBB2/ Disallow: /pop3/ Disallow: /scrollbar/ Disallow: /search/ Disallow: /selfphp/ Disallow: /sperre/ Disallow: /temp/ Disallow: /templates/ Disallow: /download/