User-agent: ABCdatos BotLink Disallow: /FLV/ User-agent: Acme.Spider Disallow: /FLV/ User-agent: Ahoy! The Homepage Finder Disallow: /FLV/ User-agent: Alkaline Disallow: /FLV/ User-agent: Anthill Disallow: /FLV/ User-agent: Walhello appie Disallow: /FLV/ User-agent: Arachnophilia Disallow: /FLV/ User-agent: Arale Disallow: /FLV/ User-agent: Araneo Disallow: /FLV/ User-agent: AraybOt Disallow: /FLV/ User-agent: ArchitextSpider Disallow: /FLV/ User-agent: Aretha Disallow: /FLV/ User-agent: ARIADNE Disallow: /FLV/ User-agent: arks Disallow: /FLV/ User-agent: ASpider (Associative Spider) Disallow: /FLV/ User-agent: ATN Worldwide Disallow: /FLV/ User-agent: Atomz.com Search Robot Disallow: /FLV/ User-agent: AURESYS Disallow: /FLV/ User-agent: BackRub Disallow: /FLV/ User-agent: unnamed Disallow: /FLV/ User-agent: BBot Disallow: /FLV/ User-agent: Big Brother Disallow: /FLV/ User-agent: Bjaaland Disallow: /FLV/ User-agent: BlackWidow Disallow: /FLV/ User-agent: Die Blinde Kuh Disallow: /FLV/ User-agent: Bloodhound Disallow: /FLV/ User-agent: Borg-Bot Disallow: /FLV/ User-agent: BoxSeaBot Disallow: /FLV/ User-agent: bright.net caching robot Disallow: /FLV/ User-agent: BSpider Disallow: /FLV/ User-agent: CACTVS Chemistry Spider Disallow: /FLV/ User-agent: Calif Disallow: /FLV/ User-agent: Cassandra Disallow: /FLV/ User-agent: Digimarc Marcspider/CGI Disallow: /FLV/ User-agent: Checkbot Disallow: /FLV/ User-agent: ChristCrawler.com Disallow: /FLV/ User-agent: churl Disallow: /FLV/ User-agent: cIeNcIaFiCcIoN.nEt Disallow: /FLV/ User-agent: CMC/0.01 Disallow: /FLV/ User-agent: Collective Disallow: /FLV/ User-agent: Combine System Disallow: /FLV/ User-agent: ConfuzzledBot Disallow: /FLV/ User-agent: CoolBot Disallow: /FLV/ User-agent: Web Core / Roots Disallow: /FLV/ User-agent: XYLEME Robot Disallow: /FLV/ User-agent: Internet Cruiser Robot Disallow: /FLV/ User-agent: Cusco Disallow: /FLV/ User-agent: CyberSpyder Link Test Disallow: /FLV/ User-agent: CydralSpider Disallow: /FLV/ User-agent: Desert Realm Spider Disallow: /FLV/ User-agent: DeWeb(c) Katalog/Index Disallow: /FLV/ User-agent: DienstSpider Disallow: /FLV/ User-agent: Digger Disallow: /FLV/ User-agent:Digital Integrity Robot Disallow: /FLV/ User-agent: Direct Hit Grabber Disallow: /FLV/ User-agent: DNAbot Disallow: /FLV/ User-agent: DownLoad Express Disallow: /FLV/ User-agent: DragonBot Disallow: /FLV/ User-agent: DWCP (Dridus' Web Cataloging Project) Disallow: /FLV/ User-agent: e-collector Disallow: /FLV/ User-agent: EbiNess Disallow: /FLV/ User-agent: EIT Link Verifier Robot Disallow: /FLV/ User-agent: ELFINBOT Disallow: /FLV/ User-agent: Emacs-w3 Search Engine Disallow: /FLV/ User-agent: ananzi Disallow: /FLV/ User-agent: esculapio Disallow: /FLV/ User-agent: Esther Disallow: /FLV/ User-agent: Evliya Celebi Disallow: /FLV/ User-agent: nzexplorer Disallow: /FLV/ User-agent: FastCrawler Disallow: /FLV/ User-agent: Fluid Dynamics Search Engine robot Disallow: /FLV/ User-agent: Felix IDE Disallow: /FLV/ User-agent: Wild Ferret Web Hopper #1, #2, #3 Disallow: /FLV/ User-agent: FetchRover Disallow: /FLV/ User-agent: User-agent:fido Disallow: /FLV/ User-agent: Hämähäkki Disallow: /FLV/ User-agent: KIT-Fireball Disallow: /FLV/ User-agent: Fish search Disallow: /FLV/ User-agent: Fouineur Disallow: /FLV/ User-agent: Robot Francoroute Disallow: /FLV/ User-agent: Freecrawl Disallow: /FLV/ User-agent: FunnelWeb Disallow: /FLV/ User-agent: gammaSpider, FocusedCrawler Disallow: /FLV/ User-agent: gazz Disallow: /FLV/ User-agent: GCreep Disallow: /FLV/ User-agent: GetBot Disallow: /FLV/ User-agent: GetURL Disallow: /FLV/ User-agent: Golem Disallow: /FLV/ User-agent: Googlebot Disallow: /FLV/ User-agent: Grapnel/0.01 Experiment Disallow: /FLV/ User-agent: Griffon Disallow: /FLV/ User-agent: Gromit Disallow: /FLV/ User-agent: Northern Light Gulliver Disallow: /FLV/ User-agent: Gulper Bot Disallow: /FLV/ User-agent: HamBot Disallow: /FLV/ User-agent: Harvest Disallow: /FLV/ User-agent: havIndexDisallow: /FLV/ User-agent: HI (HTML Index) Search Disallow: /FLV/ User-agent: Hometown Spider Pro Disallow: /FLV/ User-agent: Wired Digital Disallow: /FLV/ User-agent: ht://Dig Disallow: /FLV/ User-agent: HTMLgobble Disallow: /FLV/ User-agent: Hyper-Decontextualizer Disallow: /FLV/ User-agent: iajaBot Disallow: /FLV/ User-agent: IBM_Planetwide Disallow: /FLV/ User-agent: Popular Iconoclast Disallow: /FLV/ User-agent: Ingrid Disallow: /FLV/ User-agent: Imagelock Disallow: /FLV/ User-agent: IncyWincy Disallow: /FLV/ User-agent: Informant Disallow: /FLV/ User-agent: InfoSeek Robot 1.0 Disallow: /FLV/ User-agent: Infoseek Sidewinder Disallow: /FLV/ User-agent: InfoSpiders Disallow: /FLV/ User-agent: Inspector Web Disallow: /FLV/ User-agent: IntelliAgent Disallow: /FLV/ User-agent: I, Robot Disallow: /FLV/ User-agent: Iron33 Disallow: /FLV/ User-agent: Israeli-search Disallow: /FLV/ User-agent: JavaBee Disallow: /FLV/ User-agent: JBot Java Web Robot Disallow: /FLV/ User-agent:JCrawler Disallow: /FLV/ User-agent: AskJeeves Disallow: /FLV/ User-agent: JoBo Java Web Robot Disallow: /FLV/ User-agent: Jobot Disallow: /FLV/ User-agent: JoeBot Disallow: /FLV/ User-agent: The Jubii Indexing Robot Disallow: /FLV/ User-agent: JumpStation Disallow: /FLV/ User-agent: image.kapsi.net Disallow: /FLV/ User-agent: Katipo Disallow: /FLV/ User-agent: KDD-Explorer Disallow: /FLV/ User-agent: Kilroy Disallow: /FLV/ User-agent: KO_Yappo_Robot Disallow: /FLV/ User-agent: LabelGrabber Disallow: /FLV/ User-agent: larbin Disallow: /FLV/ User-agent: legs Disallow: /FLV/ User-agent: Link Validator Disallow: /FLV/ User-agent: LinkScan Disallow: /FLV/ User-agent: LinkWalker Disallow: /FLV/ User-agent: Lockon Disallow: /FLV/ User-agent: logo.gif Crawler Disallow: /FLV/ User-agent: Lycos Disallow: /FLV/ User-agent: Mac WWWWorm Disallow: /FLV/ User-agent: Magpie Disallow: /FLV/ User-agent: marvin/infoseek Disallow: /FLV/ User-agent: Mattie Disallow: /FLV/ User-agent: MediaFox Disallow: /FLV/ User-agent: MerzScope Disallow: /FLV/ User-agent: NEC-MeshExplorer Disallow: /FLV/ User-agent: MindCrawler Disallow: /FLV/ User-agent: mnoGoSearch search engine software Disallow: /FLV/ User-agent: moget Disallow: /FLV/ User-agent: MOMspider Disallow: /FLV/ User-agent: Monster Disallow: /FLV/ User-agent: Motor Disallow: /FLV/ User-agent: MSNBot Disallow: /FLV/ User-agent: Muncher Disallow: /FLV/ User-agent: Muninn Disallow: /FLV/ User-agent: Muscat Ferret Disallow: /FLV/ User-agent: Mwd.Search Disallow: /FLV/ User-agent: Internet Shinchakubin Disallow: /FLV/ User-agent: NDSpider Disallow: /FLV/ User-agent: NetCarta WebMap Engine Disallow: /FLV/ User-agent: NetMechanic Disallow: /FLV/ User-agent: NetScoop Disallow: /FLV/ User-agent: newscan-online Disallow: /FLV/ User-agent: NHSE Web Forager Disallow: /FLV/ User-agent: Nomad Disallow: /FLV/ User-agent: The NorthStar Robot Disallow: /FLV/ User-agent: ObjectsSearch Disallow: /FLV/ User-agent: Occam Disallow: /FLV/ User-agent: HKU WWW Octopus Disallow: /FLV/ User-agent: OntoSpider Disallow: /FLV/ User-agent: Openfind data gatherer Disallow: /FLV/ User-agent: Orb Search Disallow: /FLV/ User-agent: Pack Rat Disallow: /FLV/ User-agent: PageBoy Disallow: /FLV/ User-agent: ParaSite Disallow: /FLV/ User-agent: Patric Disallow: /FLV/ User-agent: pegasus Disallow: /FLV/ User-agent: The Peregrinator Disallow: /FLV/ User-agent: PerlCrawler 1.0 Disallow: /FLV/ User-agent: Phantom Disallow: /FLV/ User-agent: PhpDig Disallow: /FLV/ User-agent: PiltdownMan Disallow: /FLV/ User-agent: Pimptrain.com's robot Disallow: /FLV/ User-agent: Pioneer Disallow: /FLV/ User-agent: html_analyzer Disallow: /FLV/ User-agent: Portal Juice Spider Disallow: /FLV/ User-agent: PGP Key Agent Disallow: /FLV/ User-agent: PlumtreeWebAccessor Disallow: /FLV/ User-agent: Poppi Disallow: /FLV/ User-agent: PortalB Spider Disallow: /FLV/ User-agent: psbot Disallow: /FLV/ User-agent: GetterroboPlus Puu Disallow: /FLV/ User-agent: The Python Robot Disallow: /FLV/ User-agent: Raven Search Disallow: /FLV/ User-agent: RBSE Spider Disallow: /FLV/ User-agent:Resume Robot Disallow: /FLV/ User-agent: RoadHouse Crawling System Disallow: /FLV/ User-agent: RixBot Disallow: /FLV/ User-agent: Road Runner: The ImageScape Robot Disallow: /FLV/ User-agent: Robbie the Robot Disallow: /FLV/ User-agent: ComputingSite Robi/1.0 Disallow: /FLV/ User-agent: RoboCrawl Spider Disallow: /FLV/ User-agent: RoboFox Disallow: /FLV/ User-agent: Robozilla Disallow: /FLV/ User-agent: Roverbot Disallow: /FLV/ User-agent: RuLeS Disallow: /FLV/ User-agent: SafetyNet Robot Disallow: /FLV/ User-agent: Scooter Disallow: /FLV/ User-agent: Search.Aus-AU.COM Disallow: /FLV/ User-agent: Sleek Disallow: /FLV/ User-agent: SearchProcess Disallow: /FLV/ User-agent:Senrigan Disallow: /FLV/ User-agent:SG-Scout Disallow: /FLV/ User-agent:ShagSeeker Disallow: /FLV/ User-agent: Shai'Hulud Disallow: /FLV/ User-agent: Sift Disallow: /FLV/ User-agent: Simmany Robot Ver1.0 Disallow: /FLV/ User-agent: Site Valet Disallow: /FLV/ User-agent: SiteTech-Rover Disallow: /FLV/ User-agent: Skymob.com Disallow: /FLV/ User-agent: SLCrawler Disallow: /FLV/ User-agent: Inktomi Slurp Disallow: /FLV/ User-agent: Smart Spider Disallow: /FLV/ User-agent: Snooper Disallow: /FLV/ User-agent: Solbot Disallow: /FLV/ User-agent: Speedy Spider Disallow: /FLV/ User-agent: spider_monkey Disallow: /FLV/ User-agent: SpiderBot Disallow: /FLV/ User-agent: Spiderline Crawler Disallow: /FLV/ User-agent: SpiderMan Disallow: /FLV/ User-agent: SpiderView(tm) Disallow: /FLV/ User-agent: Spry Wizard Robot Disallow: /FLV/ User-agent: Site Searcher Disallow: /FLV/ User-agent: Suke Disallow: /FLV/ User-agent: suntek search engine Disallow: /FLV/ User-agent: Sven Disallow: /FLV/ User-agent: Sygol Disallow: /FLV/ User-agent: TACH Black Widow Disallow: /FLV/ User-agent: Tarantula Disallow: /FLV/ User-agent: tarspider Disallow: /FLV/ User-agent: Tcl W3 Robot Disallow: /FLV/ User-agent: TechBOT Disallow: /FLV/ User-agent: Templeton Disallow: /FLV/ User-agent: TitIn Disallow: /FLV/ User-agent: TITAN Disallow: /FLV/ User-agent: The TkWWW Robot Disallow: /FLV/ User-agent: TLSpider Disallow: /FLV/ User-agent: UCSD Crawl Disallow: /FLV/ User-agent: UdmSearch Disallow: /FLV/ User-agent: UptimeBot Disallow: /FLV/ User-agent: URL Check Disallow: /FLV/ User-agent: URL Spider Pro Disallow: /FLV/ User-agent: Valkyrie Disallow: /FLV/ User-agent: Verticrawl Disallow: /FLV/ User-agent: Victoria Disallow: /FLV/ User-agent: vision-search Disallow: /FLV/ User-agent: void-bot Disallow: /FLV/ User-agent: Voyager Disallow: /FLV/ User-agent: VWbot Disallow: /FLV/ User-agent: The NWI Robot Disallow: /FLV/ User-agent: W3M2 Disallow: /FLV/ User-agent: WallPaper (alias crawlpaper) Disallow: /FLV/ User-agent: the World Wide Web Wanderer Disallow: /FLV/ User-agent: w@pSpider by wap4.com Disallow: /FLV/ User-agent:WebBandit Web Spider Disallow: /FLV/ User-agent:WebCatcher Disallow: /FLV/ User-agent:WebCopy Disallow: /FLV/ User-agent:webfetcher Disallow: /FLV/ User-agent:The Webfoot Robot Disallow: /FLV/ User-agent: Webinator Disallow: /FLV/ User-agent: weblayers Disallow: /FLV/ User-agent: WebLinker Disallow: /FLV/ User-agent: WebMirror Disallow: /FLV/ User-agent: The Web Moose Disallow: /FLV/ User-agent: WebQuest Disallow: /FLV/ User-agent: Digimarc MarcSpider Disallow: /FLV/ User-agent: WebReaper Disallow: /FLV/ User-agent: webs Disallow: /FLV/ User-agent: Websnarf Disallow: /FLV/ User-agent: WebSpider Disallow: /FLV/ User-agent: WebVac Disallow: /FLV/ User-agent: webwalk Disallow: /FLV/ User-agent: WebWalker Disallow: /FLV/ User-agent: WebWatch Disallow: /FLV/ User-agent: Wget Disallow: /FLV/ User-agent: whatUseek Winona Disallow: /FLV/ User-agent:WhoWhere Robot Disallow: /FLV/ User-agent: Weblog Monitor Disallow: /FLV/ User-agent: w3mir Disallow: /FLV/ User-agent: WebStolperer Disallow: /FLV/ User-agent: The Web Wombat Disallow: /FLV/ User-agent: The World Wide Web Worm Disallow: /FLV/ User-agent: WWWC Ver 0.2.5 Disallow: /FLV/ User-agent: WebZinger Disallow: /FLV/ User-agent: XGET Disallow: /FLV/ User-agent: Nederland.zoek Disallow: /FLV/