# robots.txt User-agent: TFX-networx Remote-addr: 217.160.109.238 Disallow: /service/ User-agent: googlebot Allow: / User-agent: robot Disallow: / Disallow: * User-agent: crawl Disallow: / Disallow: * User-agent: spider Disallow: / Disallow: * User-agent: EmailCollector Disallow: / User-agent: lynx Disallow: / Disallow: * User-agent: Wget Disallow: / Disallow: * User-agent: Mozilla/4.0_(compatible;) Disallow: / Disallow: * User-agent: Mozilla/3.01_(compatible;) Disallow: / Disallow: * User-agent: Dumbot(version_0.1_beta_-_http://www.dumbfind.com/dumbot.html) Disallow: / Disallow: * User-agent: Java_1.1 Disallow: / Disallow: * User-agent: findlinks Allow: / User-agent: asterias/2.0 Disallow: / Disallow: * User-agent: Seekbot/1.0_(http://www.seekbot.net/bot.html)_HTTPFetcher/0.3 Disallow: / Disallow: * User-agent: seekbot Disallow: / Disallow: * User-agent: WSB Allow: / User-agent: NaverBot-1.0_(NHN_Corp._/__82-2-3011-1954_/_nhnbot@naver.com) Disallow: / Disallow: * User-agent: naverbot Disallow: / Disallow: * User-agent: webcollage/1.104 Disallow: / Disallow: * User-agent: webcollage/1.117 Disallow: / Disallow: * User-agent: webcollage Disallow: / Disallow: * User-agent: webcollage/ Disallow: / Disallow: * User-agent: DickerBrummel_|_V0.1 Disallow: / Disallow: * User-agent: libwww-perl/5.69 Disallow: / Disallow: * User-agent: webcollage/1.114 Disallow: / Disallow: * User-agent: webcollage/1.108 Disallow: / Disallow: * User-agent: webcollage/1.107 Disallow: / Disallow: * User-agent: FavOrg Disallow: / Disallow: * User-agent: Scrubby/2.2_(http://www.scrubtheweb.com/) Allow: / User-agent: Wget/1.6 Disallow: / Disallow: * User-agent: Mozilla/4.0_(compatible;_BorderManager_3.0) Disallow: / Disallow: * User-agent: Avant_Browser_(http://www.avantbrowser.com) Disallow: / Disallow: * User-agent: Java1.3.1_09 Disallow: / Disallow: * User-agent: Der_Bot_aus_Poppelsdorf_(http://www.avaris-webdesign.de) Disallow: / Disallow: * User-agent: LinkLint-checkonly/2.3.5 Disallow: / Disallow: * User-agent: PEERbot_www.peerbot.com Disallow: / Disallow: * User-agent: boitho.com-dc/0.51_(_http://www.boitho.com/dcbot.html_) Disallow: / Disallow: * User-agent: Mozilla/3.01_(compatible;_NPT_0.0_beta) Disallow: / Disallow: * User-agent: Wildsoft_Surfer Disallow: / Disallow: * User-agent: Java1.3.0_01 Disallow: / Disallow: * User-agent: Mozilla/4.0_(_________________________________) Disallow: / Disallow: * User-agent: Java1.3.1 Disallow: / Disallow: * User-agent: DLMAN Disallow: / Disallow: * User-agent: NutchCVS/0.03-dev_(Nutch;_http://www.nutch.org/docs/en/bot.html;_nutch-agent@lists.sourceforge.net) Allow: / User-agent: Mozilla/3.0_(compatible) Disallow: / Disallow: * User-agent: webcollage.perl/1.107 Disallow: / Disallow: * User-agent: webcollage/1.103 Disallow: / Disallow: * User-agent: NPBot_(http://www.nameprotect.com/botinfo.html) Disallow: / Disallow: * User-agent: NPBot Disallow: / Disallow: * User-agent: Java1.1.8 Disallow: / Disallow: * User-agent: contype Disallow: / Disallow: * User-agent: ?????7alpha Disallow: / Disallow: * User-agent: Java/1.4.2_03 Disallow: / Disallow: * User-agent: Java Disallow: / Disallow: * User-agent: RPT-HTTPClient/0.3-2 Disallow: / Disallow: * User-agent: SlimBrowser Disallow: / Disallow: * User-agent: SportSpy-URLChecker/0.1 Disallow: / Disallow: * User-agent: Mozilla/4.76_[en]_(PalmOS;_U;_WebPro/3.0;_Palm-Arz1) Disallow: / Disallow: * User-agent: Mininetz Disallow: / Disallow: * User-agent: ppn8ocfoi8eRltsoabdgv_mxiiiRR Disallow: / Disallow: * User-agent: 9tolxcdgxcndjujtlvudqtxo_y_AnxdhpAmtmr Disallow: / Disallow: * User-agent: Poodle_predictor_1.0 Allow: / User-agent: Xenu_Link_Sleuth_1.2e Disallow: / Disallow: * User-agent: Wget/1.8.1 Disallow: / Disallow: * User-agent: Wget Disallow: / Disallow: * User-agent: Java1.3.0 Disallow: / Disallow: * User-agent: RPT-HTTPClient/0.3-3E Disallow: / Disallow: * User-agent: RPT-HTTPClient Disallow: / Disallow: * User-agent: wwwster/1.2_(Beta) Disallow: / Disallow: * User-agent: Microsoft_URL_Control_-_6.00.8862 Disallow: / Disallow: * User-agent: Microsoft Disallow: / Disallow: * User-agent: Java1.0.2 Disallow: / Disallow: * User-agent: webcollage/1.102 Disallow: / Disallow: * User-agent: WebBrowser Disallow: / Disallow: * User-agent: WebStripper/2.56 Disallow: / Disallow: * User-agent: libwww-perl/5.52 Disallow: / Disallow: * User-agent: webcollage Disallow: / Disallow: * User-agent: Hotzonu/2.0 Disallow: / Disallow: * User-agent: libwww-perl/5.65 Disallow: / Disallow: * User-agent: Anonymisiert_durch_Steganos_Internet_Anonym_6 Disallow: / Disallow: * User-agent: ASPseek/1.2.10 Disallow: / Disallow: * User-agent: Mediapartners-Google/2.1 Disallow: / Disallow: * User-agent: Mozilla/8.1_(Cool-OS;_1024-bit) Disallow: / Disallow: * User-agent: Lynx_1.0_beta Disallow: / Disallow: * User-agent: GluGlu-Bot_(_http://www.gluglu.de) Disallow: / Disallow: * User-agent: Java1.3.1_07 Disallow: / Disallow: * User-agent: Mozilla/3.0_(compatible;_Indy_Library) Disallow: / Disallow: * User-agent: Dumbot(version_0.1_beta_-_dumbfind.com) Disallow: / Disallow: * User-agent: oBot Disallow: / Disallow: * User-agent: Xenu_Link_Sleuth_1.2d Disallow: / Disallow: * User-agent: Xenu_Link_Sleuth_1.2c Disallow: / Disallow: * User-agent: Webverzeichnis.de_-_Telefon:_01908_/_26005 Disallow: / Disallow: * User-agent: Lynx/2.8.5rel.1_libwww-FM/2.14_SSL-MM/1.4.1_OpenSSL/0.9.7d Disallow: / Disallow: * User-agent: libwww-perl/5.800 Disallow: / Disallow: * User-agent: SURF Disallow: / Disallow: * User-agent: Windows-Media-Player/8.00.00.4491 Disallow: / Disallow: * User-agent: IP*Works!_V5_HTTP/S_Component_-_by_/n_software_-_www.nsoftware.com Disallow: / Disallow: * User-agent: Mozilla/4.0_(compatible;_MS_FrontPage_6.0) Disallow: / Disallow: * User-agent: Java/1.4.2_01 Disallow: / Disallow: * User-agent: Mozilla/4.0_(compatible;_MSIE_29.4_Windos_7001;_DT) Disallow: / Disallow: * User-agent: SIE-CX65/04_UP.Browser/7.0.0.1.181_(GUI)_MMP/2.0_Profile/MIDP-2.0_Configuration/CLDC-1.1_(Google_WAP_Proxy/1.0) Disallow: / Disallow: * User-agent: IEXPLORE.EXE Disallow: / Disallow: * User-agent: CFNetwork/1.1 Disallow: / Disallow: * User-agent: Mozilla/4.08_(PDA;_PalmOS/sony/model_atom/Revision:2.0.26_(de))_NetFront/3.1 Disallow: / Disallow: * User-agent: GoForIt.com Disallow: / Disallow: * User-agent: Lynx/2.8.4rel.1_libwww-FM/2.14_SSL-MM/1.4.1_OpenSSL/0.9.7a Disallow: / Disallow: * User-agent: common::Proxtrans/1.00 Disallow: / Disallow: * User-agent: Mozilla/3.0_(compatible;_WebCapture_2.0;_Windows) Disallow: / Disallow: * User-agent: IlTrovatore-Setaccio/1.2_(Indexing;_http://www.iltrovatore.it/bot.html;_bot@iltrovatore.it) Disallow: / Disallow: * User-agent: aowomaecbkblfdgyoqeagq_uuh9Gnykt Disallow: / Disallow: * User-agent: RPT-HTTPClient/0.3-3 Disallow: / Disallow: * User-agent: hwvovadbwym3yti_cfLimhtsvbi Disallow: / Disallow: * User-agent: trexmod Disallow: / Disallow: * User-agent: :)_(FU;_***;_shepsoft) Disallow: / Disallow: * User-agent: Mozilla/4.0_(compatible;_WebCapture_3.0;_Windows) Disallow: / Disallow: * User-agent: Mozilla/4.0_(compatible;_B-l-i-t-z-Bot) Disallow: / Disallow: * User-agent: Crowline/0.1_(http://www.dackom.com/crowline.php) Disallow: / Disallow: * User-agent: PHP/4.2.2 Disallow: / Disallow: * User-agent: unknown/1.0 Disallow: / Disallow: * User-agent: QweeryBot_v2.05_--_http://qweerybot.qweery.com Disallow: / Disallow: * User-agent: Mozilla/2.0_(compatible;_MS_FrontPage_5.0) Disallow: / Disallow: * User-agent: jwi_cvbbnfjyebqde_nturnoxr Disallow: / Disallow: * User-agent: Mozilla/4.0_(compatible;_MSIE_5.0;_SaferSurf;_DigExt) Disallow: / Disallow: * User-agent: rfvlkyxdqk_ua0ggxkenvgx Disallow: / Disallow: * User-agent: Look.com Disallow: / Disallow: * User-agent: libwww-perl/5.75 Disallow: / Disallow: * User-agent: Mozilla/4.0_(compatible;_MSIE_5.5) Disallow: / Disallow: * User-agent: NutchCVS Allow: / User-agent: Links_SQL_(http://gossamer-threads.com/scripts/links-sql/) Disallow: / Disallow: * User-agent: Missigua_Locator_1.9 Disallow: / Disallow: * User-agent: rxtsfuycoo6JarbboiJkc_Joffpsdqjrx6hwwj Disallow: / Disallow: * User-agent: Search_Fst Disallow: / Disallow: * User-agent: mylinkcheck/1.02 Disallow: / Disallow: * User-agent: isA_lddbtprrxbwtctkkuxAqc8xgri Disallow: / Disallow: * User-agent: GeonaBot_1.0;_http://www.geona.com/ Disallow: / Disallow: * User-agent: SuBBot_(Version:_1.05,_powered_by_www.submitpoint.de) Disallow: / Disallow: * User-agent: Web_Downloader/6.0 Disallow: / Disallow: * User-agent: Bookmark-Manager Disallow: / Disallow: * User-agent: Anonymisiert_durch_Steganos_Internet_Anonym Disallow: / Disallow: * User-agent: Moozilla Disallow: / Disallow: * User-agent: KFSW-Bot_(Version:_1.01,_powered_by_www.kfsw.de) Disallow: / Disallow: * User-agent: BlackMask.Net_Search_Engine Disallow: / Disallow: * User-agent: Seekbot/1.0_(http://www.seekport.de)_HTTPFetcher/0.3 Disallow: / Disallow: * User-agent: Microsoft_Internet_Explorer Disallow: / Disallow: * User-agent: libwww-perl/5.53 Disallow: / Disallow: * User-agent: Mozilla/5.0_(compatible;_Konqueror/3.2)_(KHTML,_like_Gecko) Disallow: / Disallow: * User-agent: Nokia3510i/1.0_(04.44)_Profile/MIDP-1.0_Configuration/CLDC-1.0_(Google_WAP_Proxy/1.0) Disallow: / Disallow: * User-agent: eventax/1.3_(eventax;_http://www.eventax.de/;_info@eventax.de) Disallow: / Disallow: * User-agent: Java/1.4.2_04 Disallow: / Disallow: * User-agent: oekrmx_qhjdhwowedifmjjiursfdxrrfnkhg Disallow: / Disallow: * User-agent: Ctqvbkafattrhayrs6vswCladvfkymc Disallow: / Disallow: * User-agent: hahwpfhb_4helsblc4qiq4pulek_ofinF Disallow: / Disallow: * User-agent: appie Disallow: / Disallow: * User-agent: architext Disallow: / Disallow: * User-agent: jeeves Disallow: / Disallow: * User-agent: bjaaland Disallow: / Disallow: * User-agent: ferret Disallow: / Disallow: * User-agent: googlebot Allow: / User-agent: gulliver Disallow: / Disallow: * User-agent: harvest Disallow: / Disallow: * User-agent: htdig Disallow: / Disallow: * User-agent: linkwalker Disallow: / Disallow: * User-agent: lycos_ Disallow: / Disallow: * User-agent: moget Disallow: / Disallow: * User-agent: muscatferret Disallow: / Disallow: * User-agent: myweb Disallow: / Disallow: * User-agent: nomad Disallow: / Disallow: * User-agent: scooter Allow: / User-agent: slurp Disallow: / Disallow: * User-agent: ^voyager/ Disallow: / Disallow: * User-agent: weblayers Disallow: / Disallow: * User-agent: antibot Disallow: / Disallow: * User-agent: digout4u Disallow: / Disallow: * User-agent: echo Disallow: / Disallow: * User-agent: fast-webcrawler Allow: / User-agent: ia_archiver Allow: / User-agent: jennybot Disallow: / Disallow: * User-agent: mercator Disallow: / Disallow: * User-agent: netcraft Disallow: / Disallow: * User-agent: petersnews Disallow: / Disallow: * User-agent: unlost_web_crawler Disallow: / Disallow: * User-agent: voila Allow: / User-agent: webbase Disallow: / Disallow: * User-agent: wisenutbot Allow: / User-agent: [^a]fish Disallow: / Disallow: * User-agent: abcdatos Disallow: / Disallow: * User-agent: acme.spider Disallow: / Disallow: * User-agent: ahoythehomepagefinder Allow: / User-agent: alkaline Disallow: / Disallow: * User-agent: anthill Disallow: / Disallow: * User-agent: arachnophilia Disallow: / Disallow: * User-agent: arale Disallow: / Disallow: * User-agent: araneo Disallow: / Disallow: * User-agent: aretha Disallow: / Disallow: * User-agent: ariadne Disallow: / Disallow: * User-agent: arks Disallow: / Disallow: * User-agent: aspider Disallow: / Disallow: * User-agent: atn.txt Disallow: / Disallow: * User-agent: atomz Disallow: / Disallow: * User-agent: auresys Disallow: / Disallow: * User-agent: backrub Disallow: / Disallow: * User-agent: bbot Disallow: / Disallow: * User-agent: bigbrother Disallow: / Disallow: * User-agent: blackwidow Disallow: / Disallow: * User-agent: blindekuh Allow: / User-agent: bloodhound Disallow: / Disallow: * User-agent: borg-bot Disallow: / Disallow: * User-agent: brightnet Disallow: / Disallow: * User-agent: bspider Disallow: / Disallow: * User-agent: cactvschemistryspider Disallow: / Disallow: * User-agent: calif[^r] Disallow: / Disallow: * User-agent: cassandra Disallow: / Disallow: * User-agent: cgireader Disallow: / Disallow: * User-agent: checkbot Disallow: / Disallow: * User-agent: christcrawler Disallow: / Disallow: * User-agent: churl Disallow: / Disallow: * User-agent: cienciaficcion Disallow: / Disallow: * User-agent: collective Disallow: / Disallow: * User-agent: combine Disallow: / Disallow: * User-agent: conceptbot Disallow: / Disallow: * User-agent: coolbot Disallow: / Disallow: * User-agent: core Disallow: / Disallow: * User-agent: cosmos Disallow: / Disallow: * User-agent: cruiser Disallow: / Disallow: * User-agent: cusco Disallow: / Disallow: * User-agent: cyberspyder Disallow: / Disallow: * User-agent: desertrealm Disallow: / Disallow: * User-agent: deweb Disallow: / Disallow: * User-agent: dienstspider Disallow: / Disallow: * User-agent: digger Disallow: / Disallow: * User-agent: diibot Disallow: / Disallow: * User-agent: direct_hit Disallow: / Disallow: * User-agent: dnabot Disallow: / Disallow: * User-agent: download_express Disallow: / Disallow: * User-agent: dragonbot Disallow: / Disallow: * User-agent: dwcp Disallow: / Disallow: * User-agent: e-collector Disallow: / Disallow: * User-agent: ebiness Disallow: / Disallow: * User-agent: elfinbot Disallow: / Disallow: * User-agent: emacs Disallow: / Disallow: * User-agent: emcspider Disallow: / Disallow: * User-agent: esther Disallow: / Disallow: * User-agent: evliyacelebi Disallow: / Disallow: * User-agent: fastcrawler Disallow: / Disallow: * User-agent: fdse Disallow: / Disallow: * User-agent: felix Disallow: / Disallow: * User-agent: fetchrover Disallow: / Disallow: * User-agent: fido Disallow: / Disallow: * User-agent: finnish Disallow: / Disallow: * User-agent: fireball Disallow: / Disallow: * User-agent: fouineur Disallow: / Disallow: * User-agent: francoroute Disallow: / Disallow: * User-agent: freecrawl Disallow: / Disallow: * User-agent: funnelweb Disallow: / Disallow: * User-agent: gama Disallow: / Disallow: * User-agent: gammaSpider Disallow: / Disallow: * User-agent: gazz Disallow: / Disallow: * User-agent: gcreep Disallow: / Disallow: * User-agent: getbot Disallow: / Disallow: * User-agent: geturl Disallow: / Disallow: * User-agent: golem Disallow: / Disallow: * User-agent: grapnel Disallow: / Disallow: * User-agent: griffon Disallow: / Disallow: * User-agent: gromit Disallow: / Disallow: * User-agent: gulperbot Disallow: / Disallow: * User-agent: hambot Disallow: / Disallow: * User-agent: havindex Disallow: / Disallow: * User-agent: hometown Disallow: / Disallow: * User-agent: htmlgobble Disallow: / Disallow: * User-agent: hyperdecontextualizer Disallow: / Disallow: * User-agent: iajabot Disallow: / Disallow: * User-agent: iconoclast Disallow: / Disallow: * User-agent: ilse Disallow: / Disallow: * User-agent: imagelock Disallow: / Disallow: * User-agent: incywincy Disallow: / Disallow: * User-agent: informant Disallow: / Disallow: * User-agent: infoseek Disallow: / Disallow: * User-agent: infoseeksidewinder Disallow: / Disallow: * User-agent: infospider Disallow: / Disallow: * User-agent: inspectorwww Disallow: / Disallow: * User-agent: intelliagent Disallow: / Disallow: * User-agent: irobot Disallow: / Disallow: * User-agent: iron33 Disallow: / Disallow: * User-agent: israelisearch Disallow: / Disallow: * User-agent: javabee Disallow: / Disallow: * User-agent: jbot Disallow: / Disallow: * User-agent: jcrawler Disallow: / Disallow: * User-agent: jobo Disallow: / Disallow: * User-agent: jobot Disallow: / Disallow: * User-agent: joebot Disallow: / Disallow: * User-agent: jubii Disallow: / Disallow: * User-agent: jumpstation Disallow: / Disallow: * User-agent: kapsi Disallow: / Disallow: * User-agent: katipo Disallow: / Disallow: * User-agent: kilroy Disallow: / Disallow: * User-agent: ko_yappo_robot Disallow: / Disallow: * User-agent: labelgrabber.txt Disallow: / Disallow: * User-agent: larbin Disallow: / Disallow: * User-agent: legs Disallow: / Disallow: * User-agent: linkidator Disallow: / Disallow: * User-agent: linkscan Disallow: / Disallow: * User-agent: lockon Disallow: / Disallow: * User-agent: logo_gif Disallow: / Disallow: * User-agent: macworm Disallow: / Disallow: * User-agent: magpie Disallow: / Disallow: * User-agent: marvin Disallow: / Disallow: * User-agent: mattie Disallow: / Disallow: * User-agent: mediafox Disallow: / Disallow: * User-agent: merzscope Disallow: / Disallow: * User-agent: meshexplorer Disallow: / Disallow: * User-agent: mindcrawler Disallow: / Disallow: * User-agent: mnogosearch Disallow: / Disallow: * User-agent: momspider Disallow: / Disallow: * User-agent: monster Disallow: / Disallow: * User-agent: motor Disallow: / Disallow: * User-agent: msnbot Allow: / User-agent: muncher Disallow: / Disallow: * User-agent: mwdsearch Disallow: / Disallow: * User-agent: ndspider Disallow: / Disallow: * User-agent: nederland.zoek Disallow: / Disallow: * User-agent: netcarta Disallow: / Disallow: * User-agent: netmechanic Disallow: / Disallow: * User-agent: netscoop Disallow: / Disallow: * User-agent: newscan-online Disallow: / Disallow: * User-agent: nhse Disallow: / Disallow: * User-agent: northstar Allow: / User-agent: nzexplorer Disallow: / Disallow: * User-agent: objectssearch Disallow: / Disallow: * User-agent: occam Disallow: / Disallow: * User-agent: octopus Disallow: / Disallow: * User-agent: openfind Disallow: / Disallow: * User-agent: orb_search Disallow: / Disallow: * User-agent: packrat Disallow: / Disallow: * User-agent: pageboy Disallow: / Disallow: * User-agent: parasite Disallow: / Disallow: * User-agent: patric Disallow: / Disallow: * User-agent: pegasus Disallow: / Disallow: * User-agent: perignator Disallow: / Disallow: * User-agent: perlcrawler Disallow: / Disallow: * User-agent: phantom Disallow: / Disallow: * User-agent: phpdig Disallow: / Disallow: * User-agent: piltdownman Disallow: / Disallow: * User-agent: pimptrain Disallow: / Disallow: * User-agent: pioneer Disallow: / Disallow: * User-agent: pitkow Disallow: / Disallow: * User-agent: pjspider Disallow: / Disallow: * User-agent: plumtreewebaccessor Disallow: / Disallow: * User-agent: poppi Disallow: / Disallow: * User-agent: portalb Disallow: / Disallow: * User-agent: psbot Disallow: / Disallow: * User-agent: python Disallow: / Disallow: * User-agent: raven Disallow: / Disallow: * User-agent: rbse Disallow: / Disallow: * User-agent: resumerobot Disallow: / Disallow: * User-agent: rhcs Disallow: / Disallow: * User-agent: road_runner Disallow: / Disallow: * User-agent: robbie Disallow: / Disallow: * User-agent: robi Disallow: / Disallow: * User-agent: robocrawl Disallow: / Disallow: * User-agent: robofox Disallow: / Disallow: * User-agent: robozilla Disallow: / Disallow: * User-agent: roverbot Disallow: / Disallow: * User-agent: rules Disallow: / Disallow: * User-agent: safetynetrobot Disallow: / Disallow: * User-agent: search-info Disallow: / Disallow: * User-agent: search_au Disallow: / Disallow: * User-agent: searchprocess Disallow: / Disallow: * User-agent: senrigan Disallow: / Disallow: * User-agent: sgscout Disallow: / Disallow: * User-agent: shaggy Disallow: / Disallow: * User-agent: shaihulud Disallow: / Disallow: * User-agent: sift Disallow: / Disallow: * User-agent: simbot Disallow: / Disallow: * User-agent: site-valet Disallow: / Disallow: * User-agent: sitetech Disallow: / Disallow: * User-agent: skymob Disallow: / Disallow: * User-agent: slcrawler Disallow: / Disallow: * User-agent: smartspider Disallow: / Disallow: * User-agent: snooper Disallow: / Disallow: * User-agent: solbot Disallow: / Disallow: * User-agent: speedy Disallow: / Disallow: * User-agent: spider_monkey Disallow: / Disallow: * User-agent: spiderbot Disallow: / Disallow: * User-agent: spiderline Disallow: / Disallow: * User-agent: spiderman Disallow: / Disallow: * User-agent: spiderview Disallow: / Disallow: * User-agent: spry Disallow: / Disallow: * User-agent: ssearcher Disallow: / Disallow: * User-agent: suke Disallow: / Disallow: * User-agent: suntek Disallow: / Disallow: * User-agent: sven Disallow: / Disallow: * User-agent: tach_bw Disallow: / Disallow: * User-agent: tarantula Disallow: / Disallow: * User-agent: tarspider Disallow: / Disallow: * User-agent: techbot Disallow: / Disallow: * User-agent: templeton Disallow: / Disallow: * User-agent: titan Disallow: / Disallow: * User-agent: titin Disallow: / Disallow: * User-agent: tkwww Disallow: / Disallow: * User-agent: tlspider Disallow: / Disallow: * User-agent: ucsd Disallow: / Disallow: * User-agent: udmsearch Disallow: / Disallow: * User-agent: urlck Disallow: / Disallow: * User-agent: valkyrie Disallow: / Disallow: * User-agent: verticrawl Disallow: / Disallow: * User-agent: victoria Disallow: / Disallow: * User-agent: visionsearch Disallow: / Disallow: * User-agent: voidbot Disallow: / Disallow: * User-agent: vwbot Disallow: / Disallow: * User-agent: w3index Disallow: / Disallow: * User-agent: w3m2 Disallow: / Disallow: * User-agent: wallpaper Disallow: / Disallow: * User-agent: wanderer Disallow: / Disallow: * User-agent: wapspider Disallow: / Disallow: * User-agent: webbandit Disallow: / Disallow: * User-agent: webcatcher Disallow: / Disallow: * User-agent: webcopy Disallow: / Disallow: * User-agent: webfetcher Disallow: / Disallow: * User-agent: webfoot Disallow: / Disallow: * User-agent: webinator Disallow: / Disallow: * User-agent: weblinker Disallow: / Disallow: * User-agent: webmirror Disallow: / Disallow: * User-agent: webmoose Disallow: / Disallow: * User-agent: webquest Disallow: / Disallow: * User-agent: webreader Disallow: / Disallow: * User-agent: webreaper Disallow: / Disallow: * User-agent: websnarf Disallow: / Disallow: * User-agent: webspider Disallow: / Disallow: * User-agent: webvac Disallow: / Disallow: * User-agent: webwalk Disallow: / Disallow: * User-agent: webwalker Disallow: / Disallow: * User-agent: webwatch Disallow: / Disallow: * User-agent: whatuseek Disallow: / Disallow: * User-agent: whowhere Disallow: / Disallow: * User-agent: wired-digital Disallow: / Disallow: * User-agent: wmir Disallow: / Disallow: * User-agent: wolp Disallow: / Disallow: * User-agent: wombat Disallow: / Disallow: * User-agent: worm Disallow: / Disallow: * User-agent: wwwc Disallow: / Disallow: * User-agent: wz101 Disallow: / Disallow: * User-agent: xget Disallow: / Disallow: * User-agent: aport Disallow: / Disallow: * User-agent: awbot Disallow: / Disallow: * User-agent: baiduspider Disallow: / Disallow: * User-agent: bobby Disallow: / Disallow: * User-agent: boris Disallow: / Disallow: * User-agent: bumblebee Disallow: / Disallow: * User-agent: cscrawler Disallow: / Disallow: * User-agent: daviesbot Disallow: / Disallow: * User-agent: exactseek Disallow: / Disallow: * User-agent: ezresult Disallow: / Disallow: * User-agent: gigabot Allow: / User-agent: gnodspider Disallow: / Disallow: * User-agent: grub Disallow: / Disallow: * User-agent: henrythemiragorobot Disallow: / Disallow: * User-agent: holmes Disallow: / Disallow: * User-agent: internetseer Disallow: / Disallow: * User-agent: justview Disallow: / Disallow: * User-agent: linkbot Disallow: / Disallow: * User-agent: linkchecker Disallow: / Disallow: * User-agent: mediapartners-google Disallow: / Disallow: * User-agent: metager-linkchecker Disallow: / Disallow: * User-agent: microsoft_url_control Disallow: / Disallow: * User-agent: nagios Disallow: / Disallow: * User-agent: msiecrawler Disallow: / Disallow: * User-agent: perman Disallow: / Disallow: * User-agent: pompos Disallow: / Disallow: * User-agent: rambler Disallow: / Disallow: * User-agent: redalert Disallow: / Disallow: * User-agent: shoutcast Disallow: / Disallow: * User-agent: slysearch Disallow: / Disallow: * User-agent: surveybot Disallow: / Disallow: * User-agent: turnitinbot Disallow: / Disallow: * User-agent: turtle Disallow: / Disallow: * User-agent: turtlescanner Disallow: / Disallow: * User-agent: ultraseek Disallow: / Disallow: * User-agent: webclipping.com Disallow: / Disallow: * User-agent: webcompass Disallow: / Disallow: * User-agent: wonderer Disallow: / Disallow: * User-agent: yahoo-verticalcrawler Allow: / User-agent: yandex Disallow: / Disallow: * User-agent: zealbot Disallow: / Disallow: * User-agent: zyborg Allow: /