id_a_f_3,!Susie (http://www.sync2it.com/susie),Sync2It bookmark management & clustering engine,C R,,http://www.sync2it.com,
id_a_f_6,<a href='http://www.unchaos.com/'> UnChaos </a> From Chaos To Order Hybrid Web Search Engine.(vadim_gonchar@unchaos.com),UnCHAOS search robot,R,Site is dead,http://www.unchaos.com/,
id_a_f_7,<a href='http://www.unchaos.com/'> UnChaos Bot Hybrid Web Search Engine. </a> (vadim_gonchar@unchaos.com),UnCHAOS search robot,R,Site is dead,http://www.unchaos.com/,
id_a_f_8,<b> UnChaosBot From Chaos To Order UnChaos Hybrid Web Search Engine at www.unchaos.com </b> (info@unchaos.com),UnCHAOS search robot,R,Site is dead,http://www.unchaos.com/,
id_a_f_9,<http://www.sygol.com/> http://www.sygol.com,Sygol Search (Italy) robot,R,s.also SygolBot,http://www.sygol.com/,
id_a_f_4,( Robots.txt Validator http://www.searchengineworld.com/cgi-bin/robotcheck.cgi ),SearchEngineWorld's robots.txt validator,C,Services is no more available,http://www.searchengineworld.com/cgi-bin/robotcheck.cgi,
id_a_f_171105_1,(DreamPassport/3.0; isao/MyDiGiRabi),DreamCast DreamPassport browser,B,,http://www.dricas.com/dp/,
id_a_f_290606_1,(Privoxy/1.0),Privoxy web proxy,P,s.also Privoxy/3.0 (Anonymous),http://www.privoxy.org/,
id_a_f_230507_1,*/Nutch-0.9-dev,Unknown Yahoo robot,R,123.113.184.2xx,http://www.yahoo.com,
id_a_f_5,+SitiDi.net/SitiDiBot/1.0 (+Have Good Day),SitiDi.net search (Germany) robot,R,,http://www.sitidi.net/,
id_a_f_1,-DIE-KRAEHE- META-SEARCH-ENGINE/1.1 http://www.die-kraehe.de,Die Kraehe Meta-Search-Engine (Germany) link checking,R,,http://www.die-kraehe.de,
id_a_f_060206_1,123spider-Bot (Version: 1.02, powered by www.123spider.de,123spider.de (Germany) web directory link checking,C,,http://www.123spider.de/,
id_a_f_180806_1,192.comAgent,192.com - UK web directory,R,217.160.75.2xx,http://www.192.com/,
id_a_f_060606_1,1st ZipCommander (Net) - http://www.zipcommander.com/,1st ZipCommander Net - IE based browser,B,,http://www.zipcommander.com/,
id_a_f_10,2Bone_LinkChecker/1.0 libwww-perl/5.64,2Bone online link checker,C,,http://www.2bone.com/links/linkchecker.shtml,
id_a_f_11,4anything.com LinkChecker v2.0,4Anything robot,R,,http://www.4anything.com,
id_a_f_110207_1,8484 Boston Project v 1.0,Unknown guestbook spamming or harvesting tool from diff. IPs,S,s. various honey pot sites,http://www.projecthoneypot.org/bsh_X19tb2RlPWdsb2JhbCZfX2J5PWMmY3RyeT11cyZ1YWc9ODQ4NCtCb3N0b24rUHJvamVjdCt2KzEuMA..,
id_a_f_2,:robot/1.0 (linux) ( admin e-mail: undefined http://www.neofonie.de/loesungen/search/robot.html ),neofonie search robot Germany,R,,http://www.neofonie.de/loesungen/search/,
id_a_f_12,A-Online Search,A-Online.at robot - now Jet2Web Search,R,,http://www.jet2web.net/portal,
id_a_f_090707_1,A1 Keyword Research/1.0.2 (+http://www.micro-sys.dk/products/keyword-research/) miggibot/2007.03.27,A1 Keyword Research - search engine and keyword optimization software,C,,http://www.micro-sys.dk/products/keyword-research/,
id_a_f_100906_1,A1 Sitemap Generator/1.0 (+http://www.micro-sys.dk/products/sitemap-generator/) miggibot/2006.01.24,MiggiBot website crawler engine - A1 Sitemap Generator,R,,http://www.micro-sys.dk/products/sitemap-generator/,http://www.micro-sys.dk/developer/miggibot/
id_a_f_250408_2,aardvark-crawler,Aardvark web crawler for Sun's Blog recommendations,R,192.9.71.7x,http://blogs.sun.com/plamere/,
id_a_f_13,AbachoBOT,Abacho / Crawler.de robot,R,,http://www.abacho.com,
id_a_f_14,AbachoBOT (Mozilla compatible),Abacho / Crawler.de robot,R,,http://www.abacho.com,
id_a_f_15,ABCdatos BotLink/5.xx.xxx#BBL,ABCdatos - Castilian program & tutorial directory,R,,http://www.abcdatos.com,
id_a_f_16,Aberja Checkomat,Aberja Hybridsuchmaschine (Germany) link checking,R,,http://www.aberja.de,
id_a_f_17,abot/0.1 (abot; http://www.abot.com; abot@abot.com),Nameprotect copyright search robot (24.177.134.x),R,s. also - np/0.1_(np;_http://www.nameprotect.com... - aipbot/1.0 (aipbot; http://www.aipbot.com...,http://www.nameprotect.com/,
id_a_f_18,About/0.1libwww-perl/5.47,About robot,R,,http://www.about.com,
id_a_f_051206_3,Accelatech RSSCrawler/0.4,Accela Technology RSS feed crawler,R,125.100.242.2xx,http://www.accelatech.com/,
id_a_f_19,accoona,Accoona Search robot,R,65.17.255.xx,http://www.accoona.com,
id_a_f_20,Accoona-AI-Agent/1.1.1 (crawler at accoona dot com),Accoona Search robot,R,65.17.255.xx,http://www.accoona.com,
id_a_f_140906_3,Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com),Accoona Search robot,R,65.17.255.xx,http://www.accoona.com,
id_a_f_21,Ace Explorer,Ace Explorer - IE based browser,B,,http://www.aceexplorer.com,
id_a_f_280806_1,Ack (http://www.ackerm.com/),Ackerm search robot,R,64.74.153.xx,http://www.ackerm.com/,
id_a_f_22,AcoiRobot,Acoi picture finder robot,R,,http://monetdb.cwi.nl/acoi/projects.html,
id_a_f_23,Acoon Robot v1.50.001,Acoon.de search (Germany) robot,R,80.237.153.10x,http://www.acoon.de,
id_a_f_24,Acoon Robot v1.52 (http://www.acoon.de),Acoon.de search (Germany) robot,R,80.237.153.10x,http://www.acoon.de,
id_a_f_100508_1,Acoon-Robot 4.0.x.[xx] (http://www.acoon.de),Acoon.de search (Germany) robot,R,80.237.209.xx,http://www.acoon.de,
id_a_f_010108_1,Acoon-Robot v3.xx (http://www.acoon.de and http://www.acoon.com),Acoon.de search (Germany) robot,R,80.237.153.10x,http://www.acoon.de,
id_a_f_110507_1,Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at isara dot org),Acorn Search Project,R,124.157.145.1xx,http://acorn.no-ip.org/,
id_a_f_25,ActiveBookmark 1.x,LibMaster.com Active Bookmark HTML page creator,C B,,http://www.libmaster.com/software.php,
id_a_f_060806_2,Activeworlds,Activeworlds 3D homepage browser,B,,http://www.activeworlds.com,
id_a_f_26,ActiveWorlds/3.xx (xxx),Activeworlds 3D homepage browser,B,,http://www.activeworlds.com,
id_a_f_27,Ad Muncher v4.xx.x,Ad Muncher - banner killer,P,,http://www.admuncher.com/,
id_a_f_28,Ad Muncher v4x Build xxxxx,Ad Muncher - banner killer,P,,http://www.admuncher.com/,
id_a_f_061006_1,Adaxas Spider (http://www.adaxas.net/),website directory adaxas link checking,C,85.10.199.xx,http://www.adaxas.net/,
id_a_f_29,Advanced Browser (http://www.avantbrowser.com),Avant Browser - IE based browser,B,,http://www.avantbrowser.com,
id_a_f_30,AESOP_com_SpiderMan,Aesop robot,R,,http://www.aesop.com,
id_a_f_31,agadine/1.x.x (+http://www.agada.de),Agada search (Germany) robot,R,s. also Mozilla/4.0 (agadine3.0),http://www.agada.de,
id_a_f_32,Agent-SharewarePlazaFileCheckBot/2.0+(+http://www.SharewarePlaza.com),SharewarePlaza link checking,R,,http://www.sharewareplaza.com,
id_a_f_33,AgentName/0.1 libwww-perl/5.48,Linkomatic submission verifier,R,,http://www.linkomatic.com/,
id_a_f_34,AIBOT/2.1 By +(www.21seek.com A Real artificial intelligence search engine China),21seek.com (China) robot (218.17.90.xxx),R,,http://www.21seek.com,
id_a_f_130807_1,AideRSS/1.0 (aiderss.com),AideRss - Postrank RSS and Blog filtering,C,72.44.35.2xx,http://www.aiderss.com/,
id_a_f_35,aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com),Nameprotect copyright search robot (24.177.134.x),R,s. also - np/0.1_(np;_http://www.nameprotect.com... - abot/0.1 (abot; http://www.abot.com...,http://www.nameprotect.com/,
id_a_f_36,aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com),Nameprotect copyright search robot (24.177.134.x),R,s. also - np/0.1_(np;_http://www.nameprotect.com... - abot/0.1 (abot; http://www.abot.com...,http://www.nameprotect.com/,
id_a_f_291108_1,Akregator/1.2.9; librss/remnants,Akregator news feed reader for KDE,B,,http://akregator.kde.org/,
id_a_f_37,Aladin/3.324,Aladin robot,R,,http://www.aladin.de,
id_a_f_180408_1,Alcatel-BG3/1.0 UP.Browser/5.0.3.1.2,Phone.com UP.Browser for mobiles on Alcatel cellphone,B,,http://www.openwave.com,
id_a_f_38,Aleksika Spider/1.0 (+http://www.aleksika.com/),Aleksika Danmark - Search engine optimization spider,R,,http://www.aleksika.com,
id_a_f_291108_2,AlertInfo 2.0 (Powered by Newsbrain),Alertinfo - French version of Feedreader 3.xx ,B,,http://www.feedreader.com/,http://www.geste.fr/alertinfo/home.html
id_a_f_39,AlkalineBOT/1.3,Vestris robot,R,,http://alkaline.vestris.com/,
id_a_f_40,AlkalineBOT/1.4 (1.4.0326.0 RTM),Vestris robot,R,,http://alkaline.vestris.com/,
id_a_f_41,Allesklar/0.1 libwww-perl/5.46,Allesklar.de robot,R,,http://www.allesklar.de,
id_a_f_42,Alligator 1.31 (www.nearsoftware.com),Alligator download manager,D,,http://www.nearsoftware.com,
id_a_f_011108_1,Allrati/1.1 (+),Unknown robot from Allrati.com,R,67.205.96.xxx/67.205.104.xx,http://www.allrati.com/,
id_a_f_43,AltaVista Intranet V2.0 AVS EVAL search@freeit.com,Altavista robot,R,,http://www.altavista.com,
id_a_f_44,AltaVista Intranet V2.0 Compaq Altavista Eval sveand@altavista.net,Altavista robot,R,,http://www.altavista.com,
id_a_f_45,AltaVista Intranet V2.0 evreka.com crawler@evreka.com,Altavista robot,R,,http://www.altavista.com,
id_a_f_46,AltaVista V2.0B crawler@evreka.com,Altavista robot,R,,http://www.altavista.com,
id_new_280209_1,amaya/x.xx libwww/x.x.x,Amaya - W3C's Editor/Browser,B,,http://www.w3.org/Amaya/,
id_a_f_47,AmfibiBOT,Amfibi Search robot,R,64.111.217.9x,http://www.amfibi.com/,
id_a_f_48,Amfibibot/0.06 (Amfibi Web Search; http://www.amfibi.com; agent@amfibi.com),Amfibi Search robot,R,64.111.217.9x,http://www.amfibi.com/,
id_a_f_141105_2,Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com),Amfibi Search robot,R,64.111.217.9x,http://www.amfibi.com/,
id_a_f_49,amibot,amibot - Amidalla search engine robot (62.241.33.xx),R,s. also libwww-perl/5.65,http://www.amidalla.com/,
id_a_f_50,Amiga-AWeb/3.4.167SE,AWeb Amiga browser,B,,http://www.amitrix.com/aweb.html,
id_a_f_51,AmigaVoyager/3.4.4 (MorphOS/PPC native),Voyager - Amiga browser,B,,http://www.vapor.com/voyager/,
id_a_f_091205_1,AmiTCP Miami (AmigaOS 2.04),Amiga Miami TCP Stack,,,http://home.ptd.net/~strdustr/amirc/Netware.html,
id_a_f_210608_1,Amoi 8512/R21.0 NF-Browser/3.3,NF embedded browser on Amois Skypephone,B,,http://3skypephone.com/,
id_a_f_190206_3,amzn_assoc,Amazon.com robot for checking their affiliate sites,C,s. also aranhabot,,
id_a_f_52,AnnoMille spider 0.1 alpha - http://www.annomille.it,Annomille Italian historical oriented robot,R,,http://www.annomille.it,
id_a_f_53,annotate_google; http://ponderer.org/download/annotate_google.user.js,annotate Google - Firefox extension for annotating Google search results,B,,http://ponderer.org/annotate_google,
id_a_f_54,Anonymized by ProxyOS: http://www.megaproxy.com,Megaproxy user,P,,http://www.megaproxy.com,
id_a_f_55,Anonymizer/1.1,faked user agent,,,,
id_a_f_56,AnswerBus (http://www.answerbus.com/),AnswerBus natural language search using COLLATE technology,R,,http://www.answerbus.com,http://collate.dfki.de/kurzdarstellung.html
id_a_f_57,AnswerChase PROve x.0,AnswerChase search tool,,,http://www.answerchase.com,
id_a_f_58,AnswerChase x.0,AnswerChase search tool,,,http://www.answerchase.com,
id_a_f_59,ANTFresco/x.xx,ANT Fresco Browser,B,s. also Mozilla/x.xx (compatible; ANTFresco....),http://www.antlimited.com/products/fresco.htm,
id_a_f_60,antibot-V1.1.5/i586-linux-2.2,Antibot (discontinued) robot,R,,http://www.antidot.net,
id_a_f_61,AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au;Engine),Anzwers (Yahoo) Australia robot,R,,http://au.anzwers.yahoo.com/,
id_a_f_030206_1,Apexoo Spider 1.x,Apexoo Search spider,R,216.240.143.xx,http://www.apexoo.com/,
id_a_f_62,Aplix HTTP/1.0.1,JavaOS app. for SEGA Saturn Internet and Sanyo Internet-TV,B,,,
id_a_f_63,Aplix_SANYO_browser/1.x (Japanese),JavaOS app. for Sanyo Internet-TV,B,,,
id_a_f_64,Aplix_SEGASATURN_browser/1.x (Japanese),JavaOS app. for SEGA Saturn Internet,B,,,
id_a_f_65,Aport,Aport robot,R,,http://www.aport.ru,
id_a_f_66,appie 1.1 (www.walhello.com),Walhello Internet Search robot,R,,http://www.walhello.com,
id_a_f_140608_1,Apple iPhone v1.1.4 CoreMedia v1.0.0.4A102,CoreMedia player on Apple iPhone,B,,http://www.apple.com/iphone/,
id_a_f_070209_1,Apple-PubSub/65.1.1,PubSub - Mac OS X utility for managing RSS/Atom subscriptions via the PubSub framework,B,,http://developer.apple.com/documentation/Darwin/Reference/ManPages/man1/pubsub.1.html,
id_a_f_120707_1,ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;),Araby search - Arabia,R,209.85.31.2xx,http://www.araby.com/,
id_a_f_260608_1,ArachBot,Covac Arachnid Web Crawler,R,s.also Covac TexAs Arachbot,http://www.covac-software.com/,
id_a_f_67,Arachnoidea (arachnoidea@euroseek.com),Euroseek spider,R,,http://www.euroseek.com,
id_a_f_190206_2,aranhabot,Amazon.com robot for checking their affiliate sites,C,s. also amzn_assoc,,
id_a_f_68,ArchitextSpider,Excite spider,R,,http://www.excite.com,
id_a_f_69,archive.org_bot,Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx),R,s.also - InternetArchive/0.8-dev - Mozilla/5.0 (compatible;archive.org_bot/...,http://www.archive.org/,
id_a_f_70,Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot com),Simpy Bookmarklet crawler (69.55.233.xx),C,s. also Simpy,http://www.simpy.com/,
id_a_f_031205_1,Arikus_Spider,Arikus inContext search engine software,R,,http://www.arikus.com/inContext-enterprise.html,
id_a_f_210208_1,Arquivo-web-crawler  (compatible; heritrix/1.12.1 +http://arquivo-web.fccn.pt),Tomba project: the Portuguese web archive,R,193.136.192.xx,http://arquivo-web.fccn.pt/,http://arquivo-web.fccn.pt/crawler?set_language=en
id_a_f_251007_1,ASAHA Search Engine Turkey V.001 (http://www.asaha.com/),Asaha search robot (Turkey),R,62.68.194.2xx,http://www.asaha.com/,
id_a_f_71,Asahina-Antenna/1.x,ASAHINA Antenna information detecting agent,R,,http://masshy.fastwave.gr.jp/hina/release/,
id_a_f_72,Asahina-Antenna/1.x (libhina.pl/x.x ; libtime.pl/x.x),ASAHINA Antenna information detecting agent,R,,http://masshy.fastwave.gr.jp/hina/release/,
id_a_f_73,ask.24x.info,Ask 24x Info robot,R,,http://ask.24x.info/,
id_a_f_74,AskAboutOil/0.06-rcp (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@askaboutoil.com),Ask About Oil - Petroleum related search (24.227.212.xxx) using Nutch,R,,http://askaboutoil.com/search.jsp,http://www.nutch.org
id_a_f_120806_1,asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot com),askEd! / Inferret search (Japan) robot using Nutch,R,131.112.125.1xx,http://asked.jp/,
id_a_f_75,ASPSeek/1.2.5,ASPSeek search engine software -Yahoo-Inc. / Telecom Canada robot ,R,,http://www.aspseek.org,
id_a_f_76,ASPseek/1.2.9d,Swsoft.net robot using Aspseek,R,,http://www.aspseek.com,
id_a_f_77,ASPSeek/1.2.x,ASPSeek search engine software,R,,http://www.aspseek.org,
id_a_f_78,ASPSeek/1.2.xa,ASPSeek search engine software,R,,http://www.aspseek.org,
id_a_f_79,ASPseek/1.2.xx,ASPSeek search engine software,R,,http://www.aspseek.org,
id_a_f_80,ASPSeek/1.2.xxpre,ASPSeek search engine software,R,,http://www.aspseek.org,
id_a_f_81,ASSORT/0.10,Associative Sort robot,R,site is down,http://pcmath126.unice.fr/assort-robot.html,
id_a_f_82,asterias/2.0,Singingfish media spider (64.12.186.2xx) via AOL search,R,s. also Mozilla/4.0 (compatible; MSIE 6.0 compatible; Asterias Crawler ...,http://search.singingfish.com/sfw/home.jsp,
id_a_f_83,AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html),Atlocal local business search robot,R,,http://www.atlocal.com/,
id_a_f_041207_2,Atomic_Email_Hunter/4.0,Atomic Email Hunter email extracing and harvesting,S,,,
id_a_f_84,Atomz/1.0,Atomz robot,R,,http://www.atomz.com,
id_a_f_85,atSpider/1.0,atSpider (ceased) email harvester / spambot,S,,,
id_a_f_060707_1,Attentio/Nutch-0.9-dev (Attentio's beta blog crawler; www.attentio.com; info@attentio.com),Attentio social media monitoring and analysing ,R,85.88.35.xx,http://www.attentio.com/,
id_a_f_231105_2,AU-MIC/2.0 MMP/2.0,Samsung SPH-A660 phone with Sprint software,B,,http://www1.sprintpcs.com/explore/showcase/Showcase.jsp?scTopic=pcsVision,
id_a_f_240208_1,AUDIOVOX-SMT5600,Audiovox SMT5600 (AT&T) Smartphone mobile phone browser,B,,http://www.audiovox.com/,http://www.audiovox.com/manuals/owners/SMT%205600%20QSG%209-7%20FINAL.pdf
id_a_f_86,augurfind,Augurnet Swiss (was www.augurnet.ch) search robot,R,,,
id_a_f_87,augurnfind V-1.x,Augurnet Swiss (was www.augurnet.ch) search robot,R,,,
id_a_f_88,autoemailspider,Auto Email Pro Email harvester,S,was http://autoemailspider.com - site is dead,,
id_a_f_89,autohttp,Linkscan tool from Elsop,C,s. Linkscan/x ?,http://www.elsop.com/linkscan/,
id_a_f_050208_1,autowebdir 1.1 (www.autowebdir.com),Autowebdir - The Automatically Generated Web Directory,R,84.104.43.x,http://www.autowebdir.com/,
id_a_f_90,AV Fetch 1.0,Altavista robot ??,R,,http://www.altavista.com/,
id_a_f_91,Avant Browser (http://www.avantbrowser.com),Avant Browser - IE based browser,B,,http://www.avantbrowser.com,
id_a_f_92,AVSearch-1.0(peter.turney@nrc.ca),National Research Council Canada robot,R,,http://www.nrc-cnrc.gc.ca/main_e.html,
id_a_f_93,AVSearch-2.0-fusionIdx-14-CompetitorWebSites,Unknown robot from 205.203.108.xx (telerate.com),,,,
id_a_f_94,AVSearch-3.0(AltaVista/AVC),Altavista robot,R,,http://www.altavista.com/,
id_a_f_95,AWeb,AWeb Amiga browser,B,,http://aweb.sunsite.dk/,
id_a_f_96,axadine/ (Axadine Crawler; http://www.axada.de/; ),Axada search Germany robot,R,,http://www.axada.de,
id_a_f_97,AxmoRobot - Crawling your site for better indexing on www.axmo.com search engine.,Axmo search robot,R,,http://www.axmo.com,
id_a_f_250306_1,Azureus 2.x.x.x,Azureus Java BitTorrent Client,D,,http://azureus.sourceforge.net/,
id_a_f_131208_1,BabalooSpider/1.3 (BabalooSpider; http://www.babaloo.si; spider@babaloo.si),Babaloo search robot (Slovenia),R,84.255.237.2xx,http://www.babaloo.si/,
id_a_f_98,BaboomBot/1.x.x (+http://www.baboom.us),BaBoom Web Portal (ODP) robot (66.98.254.xx),R,,http://www.baboom.us,
id_a_f_050406_1,BackStreet Browser 3.x,BackStreet Browser - Offline browser / website downloader,D,,http://www.spadixbd.com/backstreet/,
id_a_f_140508_1,BaiduImagespider+(+http://www.baidu.jp/search/s308.html),Baidu search (Japan) image crawler,R,119.63.193.94.[x]xx,http://www.baidu.jp/,
id_a_f_99,BaiDuSpider,Baidu spidering engine - used by diff. IPs,R,,http://www.baidu.com,
id_a_f_080608_1,Baiduspider+(+http://help.baidu.jp/system/05.html),Baidu spidering engine - used by diff. IPs,R,,http://www.baidu.com,
id_a_f_100,Baiduspider+(+http://www.baidu.com/search/spider.htm),Baidu spidering engine - used by diff. IPs,R,,http://www.baidu.com,
id_a_f_080407_1,Baiduspider+(+http://www.baidu.com/search/spider_jp.html),Baidu search (Japan) crawler,R,119.63.193.[x]xx,http://www.baidu.jp,
id_a_f_031107_1,Balihoo/Nutch-1.0-dev (Crawler for Balihoo.com search engine - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com),Balihoo - Vertical search engine crawler (beta),R,,http://www.balihoo.com/,http://www.balihoo.com/pdfs/BalihooFactSheet.pdf
id_a_f_101,BanBots/1.2 (spider@banbots.com),Project BanBots Perl script robot,C,s. also Mozilla/5.0 (compatible; BanBots/2.0b..,http://www.banbots.com/,
id_a_f_140506_3,Barca/2.0.xxxx,Barca Pro email & PIM software,B,,http://www.pocosystems.com/home/index.php?option=com_content&task=view&id=105&Itemid=54,
id_a_f_120206_2,BarcaPro/1.4.xxxx,Barca Pro email & PIM software,B,,http://www.pocosystems.com/home/index.php?option=com_content&task=view&id=105&Itemid=54,
id_a_f_102,BarraHomeCrawler (albertof@barrahome.org),Barrahome crawler,R,64.246.56.xx,http://www.barrahome.org,
id_a_f_011006_1,bCentral Billing Post-Process,Unknown user agent from Microsoft,,204.71.191.1xx,,
id_a_f_103,bdcindexer_2.6.2 (research@bdc),Business.com robot,R,208.144.233.xxx,http://www.business.com,
id_a_f_104,BDFetch,Brandimensions Brand Protection robot,R,,http://www.brandimensions.com/,
id_a_f_105,BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686),Bdncentral Sitesearch robot,R,,http://www.bdncentral.com,
id_a_f_111205_3,BeamMachine/0.5 (dead link remover of www.beammachine.net),beammachine web directory (Germany) link checking,R C,,http://www.beammachine.net/de/,
id_a_f_106,beautybot/1.0 (+http://www.uchoose.de/crawler/beautybot/),Beauty robot for Cosmoty - German beauty and wellness search,R,,http://www.cosmoty.de,http://www.uchoose.de/Projekte/Lifestyle/beauty/
id_a_f_230406_1,BebopBot/2.5.1 ( crawler http://www.apassion4jazz.net/bebopbot.html ),A Passion for Jazz music related search robot,R,68.6.204.2xx,http://www.apassion4jazz.net/,
id_a_f_107,BeebwareDirectory/v0.01,LinkcheckerBeepware (site is down) web directory link checking,C,,http://directory.beebware.co.uk,
id_a_f_108,Big Brother (http://pauillac.inria.fr/~fpottier/),Big Brother link checking tool,C,,http://pauillac.inria.fr,
id_a_f_130606_1,Big Fish v1.0,GoonGee.com link popularity checking,C,216.89.111.x,http://www.goongee.com/big-fish/,
id_a_f_109,BigBrother/1.6e,BB4 network monitoring,C,,http://www.bb4.com,
id_a_f_110,BigCliqueBOT/1.03-dev (bigclicbot; http://www.bigclique.com; bot@bigclique.com),BigClique Search robot,R,,http://www.bigclique.com,
id_a_f_080206_4,BIGLOTRON (Beta 2;GNU/Linux),Biglotron search (France) robot,R,,http://www.biglotron.com/,
id_a_f_171106_2,Bigsearch.ca/Nutch-x.x-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com),Bigsearch.ca search robot,R,72.0.207.1xx,http://www.bigsearch.ca/,
id_a_f_111,Bilbo/2.3b-UNIX,Bilbo - web frontend for the Nessus Security Scanner,C,,http://home.broadpark.no/%7Etnilsen-1/Linux/Bilbo_-_Nessus_WEB/bilbo_-_nessus_web.html,
id_a_f_170806_1,BilgiBetaBot/0.8-dev (bilgi.com (Beta) ; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org),Bilgi.com (Beta) search robot - Turkey,R,212.156.230.2xx,http://www.bilgi.com/,
id_a_f_080607_1,BilgiBot/1.0(beta) (http://www.bilgi.com/; bilgi at bilgi dot com),Bilgi.com (Beta) search robot - Turkey,R,212.156.230.2xx,http://www.bilgi.com/,
id_a_f_112,billbot wjj@cs.cmu.edu,Carnegie Mellon School robot/link checking ?,C,,http://www.cs.cmu.edu,
id_a_f_050206_3,Bitacle bot/1.1,Bitacle Blog Search Archive robot,R,,http://bitacle.org/,
id_a_f_050206_2,Bitacle Robot (V:1.0;) (http://www.bitacle.com),Bitacle Blog Search Archive robot,R,,http://bitacle.org/,
id_a_f_113,Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx),Biyubi Navigator - Mexican browser for Fenix OS,B,,http://www.biyubi.com,
id_a_f_114,BlackBerry7520/4.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/5.0.3.3 UP.Link/5.1.2.12 (Google WAP Proxy/1.0),Blackberry Wireless Internet browser via Google WAP Proxy,B P,,http://www.blackberry.com/products/service/web.shtml,http://www.openwave.com
id_a_f_115,BlackWidow,FS Consulting (was www.fsconsult.net) Black Widow web crawler,R,,,
id_a_f_010306_1,BlackWidow,BlackWidow web site scanner / downloading tool,D,,http://www.softbytelabs.com/BlackWidow,
id_a_f_116,Blaiz-Bee/1.0 (+http://www.blaiz.net),Blaiz Enterprises RawGrunt search,R,203.87.123.1xx,http://www.rawgrunt.com/,http://www.blaiz.net
id_a_f_160307_1,Blaiz-Bee/2.00.8222 (BE Internet Search Engine http://www.rawgrunt.com),Blaiz Enterprises RawGrunt search,R,203.87.123.1xx,http://www.rawgrunt.com/,http://www.blaiz.net
id_a_f_240706_1,Blaiz-Bee/2.00.xxxx (+http://www.blaiz.net),Blaiz Enterprises RawGrunt search,R,203.87.123.1xx,http://www.rawgrunt.com/,http://www.blaiz.net
id_a_f_117,BlitzBOT@tricus.net,Blitzsuche Germany robot,R,,http://blitzsuche.rp-online.de/,
id_a_f_118,BlitzBOT@tricus.net (Mozilla compatible),Blitzsuche Germany robot,R,,http://blitzsuche.rp-online.de/,
id_a_f_090307_1,BlockNote.Net,BlockNote web page editor,B,,http://blocknote.net/,
id_a_f_119,BlogBot/1.x,blogdex robot from MIT.edu,R,,http://blogdex.media.mit.edu/,
id_a_f_071206_1,BlogBridge 2.13 (http://www.blogbridge.com/),BlogBridge RSS reader,B,,http://www.blogbridge.com/,
id_a_f_120,Bloglines Title Fetch/1.0 (http://www.bloglines.com),Bloglines article search,R,65.214.44.xx,http://www.bloglines.com,
id_a_f_250907_1,Bloglines-Images/0.1 (http://www.bloglines.com),Bloglines graphics crawler,R,65.214.44.xx,http://www.bloglines.com,
id_a_f_011108_2,Bloglines/3.1 (http://www.bloglines.com),Bloglines news crawler,R,65.214.44.xx,http://www.bloglines.com,
id_a_f_071206_2,BlogMap (http://www.feedmap.net),FeedMap / BlogMap geo coding service,C,,http://www.feedmap.net/BlogMap/,
id_a_f_121,Blogpulse (info@blogpulse.com),Intelliseek's BlogPulse blog search,R,64.158.138.xx,http://www.blogpulse.com,
id_a_f_050208_2,BlogPulseLive (support@blogpulse.com),Intelliseek's BlogPulse blog search,R,64.158.138.xx,http://www.blogpulse.com,
id_a_f_161206_2,BlogSearch/1.x +http://www.icerocket.com/,IceRocket Web search robot,R,s. also BlogzIce ...,http://www.icerocket.com,
id_a_f_020707_1,blogsearchbot-pumpkin-3,Art of Computing blog search project,R,88.198.44.2xx,http://artofcomputing.net/blog/?p=4,
id_a_f_241205_1,BlogsNowBot, V 2.01 (+http://www.blogsnow.com/),BlogsNow realtime link tracker robot,R,,http://www.blogsnow.com/,
id_a_f_261107_1,BlogVibeBot-v1.1 (spider@blogvibe.nl),BlogVipe news and Blog crawler (Netherlands),R,212.61.21.xx,http://www.blogvibe.nl,
id_a_f_122,blogWatcher_Spider/0.1 (http://www.lr.pi.titech.ac.jp/blogWatcher/),blogWatcher robot from Okumura Group Tokyo (131.112.182.xxx),R,,http://www.lr.pi.titech.ac.jp,
id_a_f_123,BlogzIce/1.0 (+http://icerocket.com; rhodes@icerocket.com),IceRocket Web search robot,R,s. also BlogSearch ...,http://www.icerocket.com,
id_a_f_124,BlogzIce/1.0 +http://www.icerocket.com/,IceRocket Web search robot,R,s. also BlogSearch ...,http://www.icerocket.com,
id_a_f_310108_1,BloobyBot,Blooby search (beta) robot,R,206.166.206.18x,http://www.blooby.com/,
id_a_f_270507_1,Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com),Balihoo - Search Engine for Advertising Media,R,204.228.230.xx,http://balihoo.com/,
id_a_f_125,bluefish 0.6 HTML editor,Bluefish HTML-editor for Linux,B,,http://bluefish.openoffice.nl/,
id_a_f_126,BMCLIENT,Part of ButtMan remote access tool,,seems to be a Trojan - see link,http://www.glocksoft.com/trojan_list/ButtMan.htm,
id_a_f_120506_1,BMLAUNCHER,Bookmark Express bookmark manager,C,Website is dead - was:,http://www.bookmarkexpress.com/,
id_a_f_127,Bobby/4.0.x RPT-HTTPClient/0.3-3E,Bobby web accessibility desktop testing tool,C,,http://bobby.watchfire.com/bobby/html/en/index.jsp,
id_a_f_128,boitho.com-dc/0.xx (http://www.boitho.com/dcbot.html),Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx,R,,http://www.boitho.com,
id_a_f_129,boitho.com-robot/1.x,Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx,R,,http://www.boitho.com,
id_a_f_130,boitho.com-robot/1.x (http://www.boitho.com/bot.html),Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx,R,,http://www.boitho.com,
id_a_f_060806_1,Bookdog/x.x,Bookdog - Mac bookmark manager,C,,http://www.sheepsystems.com/bookdog/,
id_a_f_131,Bookmark Buddy bookmark checker (http://www.bookmarkbuddy.net/),Bookmark Buddy - favorite bookmark manager ,C,,http://www.bookmarkbuddy.net,
id_a_f_132,Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/],Favourites managing program,C,,http://www.bookmark.ne.jp,
id_a_f_230807_1,Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] (Version 2.0beta),Favourites managing program,C,,http://www.bookmark.ne.jp,
id_a_f_300408_1,BookmarkBase(2/;http://bookmarkbase.com),Bookmark Base bookmark manager,C,,http://www.bookmarkbase.com/,
id_a_f_133,Bot mailto:craftbot@yahoo.com,cybercity.fr user robot / faked user agent ?,,,,
id_a_f_160308_1,BPImageWalker/2.0 (www.bdbrandprotect.com),BD-Brandprotect copyright infringement crawler,R,72.14.164.1xx,http://www.bdbrandprotect.com/,http://www.bdbrandprotect.com/solutions_5.html
id_a_f_134,BravoBrian bstop.bravobrian.it,BravoBrian bSTOP parental control,P R, s. also BStop,http://bstop.bravobrian.it/,
id_a_f_135,BravoBrian SpiderEngine MarcoPolo,Robot for BravoBrian bSTOP,R, s. also BStop,http://bstop.bravobrian.it/,
id_a_f_220508_1,BrightCrawler (http://www.brightcloud.com/brightcrawler.asp),BrightCloud web filtering for classifying websites,P R,,http://www.brightcloud.com/brightcrawler.asp,
id_a_f_136,BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html) ,Webarchive Project Bruinbot crawler,R,,http://webarchive.cs.ucla.edu,
id_a_f_137,BSDSeek/1.0,Inktomi (Hotbot-Lycos NBCi) robot,R,,http://www.inktomi.com/,
id_a_f_138,BStop.BravoBrian.it Agent Detector,BravoBrian bSTOP parental control,P R,s. also BravoBrian ..,http://bstop.bravobrian.it/,
id_a_f_139,BTbot/0.x (+http://www.btbot.com/btbot.html),BitTorrent Search Engine btbot robot,R,,http://www.btbot.com,
id_a_f_300408_2,BTWebClient/180B(9704),µTorrent BitTorrent Client,D,,http://www.utorrent.com/,
id_a_f_080407_2,BuildCMS crawler (http://www.buildcms.com/crawler),BuildCMS crawler - market monitoring project of BuildCMS,R,194.24.253.xx,http://www.buildcms.com/index.php,http://www.buildcms.com/about_us/crawler
id_a_f_051206_4,Bulkfeeds/r1752 (http://bulkfeeds.net/),Bulkfeeds: RSS directory link checking,C,202.181.96.2xx,http://bulkfeeds.net/,
id_a_f_140,BullsEye,BullsEye/Intelliseek robot,R,,http://www.intelliseek.com/be/bullseye.htm,
id_a_f_141,bumblebee@relevare.com,Relevare Portal software robot,R,,http://www.relevare.com,
id_a_f_142,BunnySlippers,Microsoft server information robot (see link),C,,http://www.webmasterworld.com/forum11/841.htm,
id_a_f_070606_1,BurstFindCrawler/1.1 (crawler.burstfind.com; http://crawler.burstfind.com; crawler@burstfind.com),BurstFind search crawler (64.34.172.xx),R,,http://www.burstfind.com/,
id_a_f_143,Buscaplus Robi/1.0 (http://www.buscaplus.com/robi/),Buscaplus (Spain) robot,R,,http://www.buscaplus.com,
id_a_f_050807_2,BW-C-2.0,Logitech Desktop Managers (LDM) Backweb (BW) update check,D,,http://www.logitech.com/index.cfm/494/3041&cl=de,de,
id_a_f_140508_2,bwh3_user_agent,Basic Web Hacking 3 fake user-agent from Hellbound Hackers challenges,S,,http://www.hellboundhackers.org/forum/_basic_web_hacking_3-7-6960_0.html,http://vuau.wordpress.com/2008/03/12/hbh-basic-web-3-switch-user-agent/
id_a_f_140508_3,Cabot/Nutch-0.9 (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com),Amfibi Search robot,R,64.111.217.9x,http://www.amfibi.com/,
id_a_f_280508_1,Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com),Amfibi Search robot,R,64.111.217.9x,http://www.amfibi.com/,
id_a_f_140506_4,CamelHttpStream/1.0,Evolution integrated mail solution Camel TCP stream class,,,http://www.gnome.org/projects/evolution/,http://go-evolution.org/Camel.Stream
id_a_f_144,Cancer Information and Support International;,Some user agent,,,,
id_a_f_110206_1,carleson/1.0,Cosmix project crawler (204.14.48.x / 38.113.234.xxx),R,s. also - voyager/1.x - cfetch/1.,http://www.cosmixcorp.com/,
id_a_f_145,Carnegie_Mellon_University_Research_WebBOT-->PLEASE READ-->http://www.andrew.cmu.edu/~brgordon/webbot/index.html http://www.andrew.cmu.edu/~brgordon/webbot/index.html,Carnegie Mellon University WebBOT,R,,http://www.andrew.cmu.edu,
id_a_f_146,Carnegie_Mellon_University_WebCrawler http://www.andrew.cmu.edu/~brgordon/webbot/index.html,Carnegie Mellon University WebBOT,R,,http://www.andrew.cmu.edu,
id_a_f_170206_1,Catall Spider,Catall.de search & web directory (Germany),R,,http://www.catall.de/,
id_a_f_130807_3,CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com),UIUCs Cazoodle search based on MetaQuerier,R,72.36.94.1xx,http://www.cazoodle.com/,http://metaquerier.cs.uiuc.edu/
id_a_f_290308_1,CCBot/1.0 (+http://www.commoncrawl.org/bot.html),CommonCrawl Foundation search crawler,R,38.103.63.1[6-8],http://www.commoncrawl.org/faq.htm,
id_a_f_147,ccubee/x.x,Empyreum Ccubee (Czech) search engine solution,R,,http://empyreum.com/technologies/ccubee,
id_a_f_010108_2,CDR/1.7.1 Simulator/0.7(+http://timewe.net) Profile/MIDP-1.0 Configuration/CLDC-1.0,Timewe mobile browser (WAP) simulator (Japan),B,61.142.xx.x[xx],http://timewe.net/,
id_a_f_291105_6,CE-Preload,Cisco Content Engine,P,,http://www.cisco.com/en/US/products/hw/contnetw/index.html,
id_a_f_100408_4,CentiverseBot,Nordic semantic search engine,C,87.72.214.9x,http://www.centiverse-project.net/post/Educating-the-bots.aspx,
id_a_f_180408_2,CentiverseBot - investigator,Nordic semantic search engine,C,87.72.214.9x,http://www.centiverse-project.net/post/Educating-the-bots.aspx,
id_a_f_180408_3,CentiverseBot/3.0 (http://www.centiverse-project.net),Nordic semantic search engine,C,87.72.214.9x,http://www.centiverse-project.net/post/Educating-the-bots.aspx,
id_a_f_148,Ceramic Tile Installation Guide (http://www.floorstransformed.com),Floortransformed.com robot (link ckecking ??),R,,http://www.floorstransformed.com,
id_a_f_131208_2,CERN-LineMode/2.15,CERN Line Mode Browser,B,,http://www.w3.org/LineMode/,
id_a_f_149,cfetch/1.0,Cosmix project crawler (204.14.48.x / 38.113.234.xxx),R,s. also - voyager/1.x - carleson/1.x,http://www.cosmixcorp.com,
id_a_f_150,CFNetwork/x.x,MaxOS X CoreFoundation CFNetwork API,,,http://www.cocoadev.com/index.pl?CFNetwork,
id_a_f_151,cg-eye interactive,cg-eye CGI checker,C,,http://www.htmlhelp.com,
id_a_f_152,Charon/1.x (Amiga),Charon Amiga download manager,D,,http://tesla.rcub.bg.ac.yu/%7Eantony/Charon/,
id_a_f_131208_3,Chat Catcher/1.0,Chat Catcher blog monitoring robot,C,69.80.208.2xx,http://chatcatcher.com/cc/,
id_a_f_153,Checkbot/1.xx LWP/5.xx,Checkbot link validation,C,,http://degraaff.org/checkbot/,
id_a_f_154,CheckLinks/1.x.x,Checklinks - Perl link checker,C,,http://www.jmarshall.com,
id_a_f_155,CheckUrl,NTL user agent,,,http://www.ntl.com,
id_a_f_156,CheckWeb,CheckWeb link validation,C,,http://p.duby.free.fr/chkweb.htm,
id_a_f_030206_2,Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp),Chilkat HTTP component user-agent,,,http://www.chilkatsoft.com/HttpDotNet.asp,
id_a_f_230506_1,China Local Browse 2.6,Unknown spam bot from telekom.com.my (218.111.83.xxx),S,see link:,http://linuxreviews.org/webdesign/602_Apache_Webalizer/,
id_a_f_170408_2,Chitika ContentHit 1.0,Chitika Inc. Blog advertising,C,67.15.219.[x]x,http://chitika.com/,
id_a_f_157,ChristCRAWLER 2.0,Christcentral.com Christcrawler (was www.christcrawler.com),R,- s. also Mozilla/4.0 (compatible; ChristCrawler..),,
id_a_f_010607_2,CHttpClient by Open Text Corporation,CHttpClient - C++ class using WinInet,,,http://www.codeproject.com/library/lyoulhttpclient.asp,
id_a_f_158,CipinetBot (http://www.cipinet.com/bot.html),CipinetBot -Cipinet Search Engine Web Crawler,R,,http://www.cipinet.com,
id_a_f_130108_1,Cityreview Robot (+http://www.cityreview.org/crawler/),Cityreview regional search (Germany) link checking,C,88.198.212.5x,http://www.cityreview.de/,http://www.cityreview.org/crawler/
id_a_f_159,CJ Spider/,Commision Junction link checking spider,C,,http://www.cj.com/,
id_a_f_050606_1,CJB.NET Proxy,CJB Net anonymous socks proxy service (216.194.70.x),P,,http://proxy.cjb.net/,
id_a_f_160,ClariaBot/1.0,Claria (ex Gator) SearchScout robot (64.152.73.xx),R,s. also Diamond,http://www.searchscout.com,
id_a_f_161,Claymont.com,Claymont Search robot,R,,http://www.claymont.com,
id_a_f_100307_1,CloakDetect/0.9 (+http://fulltext.seznam.cz/),Seznam Search (Czech Republic) robot,R,212.80.76.xx,http://www.seznam.cz/,
id_a_f_162,Clushbot/2.x (+http://www.clush.com/bot.html),Clush clustered search robot,R,,http://www.clush.com,
id_a_f_163,Clushbot/3.x-BinaryFury (+http://www.clush.com/bot.html),Clush clustered search robot,R,,http://www.clush.com,
id_a_f_164,Clushbot/3.xx-Ajax (+http://www.clush.com/bot.html),Clush clustered search robot,R,,http://www.clush.com,
id_a_f_165,Clushbot/3.xx-Hector (+http://www.clush.com/bot.html),Clush clustered search robot,R,,http://www.clush.com,
id_a_f_166,Clushbot/3.xx-Peleus (+http://www.clush.com/bot.html),Clush clustered search robot,R,,http://www.clush.com,
id_a_f_070506_1,COAST WebMaster Pro/4.x.x.xx (Windows NT),COAST Webmaster - Web management and maintenance software,C,,http://www.extablish.com/cwm.htm,
id_a_f_150306_1,CoBITSProbe,Proposed Content-Based Image Tracking System (CoBITS) P2P crawler,R C,,http://www.iis.sinica.edu.tw/~hungchi/CBIT/,
id_a_f_167,Cocoal.icio.us/1.0 (v36) (Mac OS X; http://www.scifihifi.com/cocoalicious),Cocoa del.icio.us (social bookmarks manager) client for Mac OS X,C,,http://www.scifihifi.com,
id_a_f_070209_2,Cogentbot/1.X (+http://www.cogentsoftwaresolutions.com/bot.html),Cogent Search Bot from Cogent Software Solutions for unknown purposes,R,72.81.252.9x,http://www.cogentsoftwaresolutions.com/bot.html,
id_a_f_168,ColdFusion,Cold Fusion server used by various IPs i.e.: - NetWORLD web catalogue link checking,P C,,http://www.networld.com,http://www.macromedia.com/software/coldfusion/
id_a_f_169,ColdFusion (BookmarkTracker.com),Cold Fusion server used by Bookmark Tracker - online favourites managment,C,,http://www.bookmarktracker.com,http://www.macromedia.com/software/coldfusion/
id_a_f_170,collage.cgi/1.xx,WebCollage Syndicator graphics crawler/collector,R D,,http://www.webcollage.com,
id_a_f_171,combine/0.0,Combine harvesting & indexing robot,R,130.235.4.xx,http://combine.it.lth.se/,
id_a_f_080406_1,Combine/2.0 http://combine.it.lth.se/,Combine harvesting & indexing robot,R,130.235.4.xx,http://combine.it.lth.se/,
id_a_f_160807_1,Combine/3 http://combine.it.lth.se/,Combine harvesting & indexing robot,R,130.235.4.xx,http://combine.it.lth.se/,
id_a_f_172,Combine/x.0,Combine harvesting & indexing robot,R,130.235.4.xx,http://combine.it.lth.se/,
id_a_f_280606_3,cometrics-bot, http://www.cometrics.de,cometrics Web Content Mining solution - Germany,R,,http://www.cometrics.de/,
id_a_f_173,Commerce Browser Center,Wildsoft Germany (closed) Internet client system user-agent (was www.oskarweb.de),B,,,
id_a_f_240107_1,complex_network_group/Nutch-0.9-dev (discovering the structure of the world-wide-web; http://cantor.ee.ucla.edu/~networks/crawl; nimakhaj@gmail.com),UCLA Complex Networks Groups Complex Network Analysis,C,216.182.233.1xx,http://cantor.ee.ucla.edu/~networks/,
id_a_f_174,Computer_and_Automation_Research_Institute_Crawler crawler@ilab.sztaki.hu,Hungarian Academy of Sciences data mining search,R,,http://www.ilab.sztaki.hu/websearch/,
id_a_f_010406_2,Comrite/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org),ComRite Chinese Search Engine for Oversea Web Sites (69.248.26.xx),R,powered by Nutch,http://www.comrite.com/,http://meidong.comrite.com/
id_a_f_175,Contact,unknown,,,,
id_a_f_200307_1,ContactBot/0.2,Probably E-Mail harvesting robot - same as LMQueueBot,S,64.124.152.xx,,
id_a_f_291105_7,ContentSmartz,ContentSmartz e-mail harvesting tools,S,,,
id_a_f_176,contype,Internet Explorer versions 4.x and 5 plugin content,B,NOT Contype mime type managment Perl script,http://support.microsoft.com/default.aspx?scid=kb;en-us;293792,
id_a_f_177,Convera Internet Spider V6.x,Converas RetrievalWare Internet Spider (63.241.61.x),R, s. also - infoConveraCrawler... - CrawlConvera ...,http://www.convera.com,
id_a_f_178,ConveraCrawler/0.2,Converas RetrievalWare Internet Spider (63.241.61.x),R, s. also - infoConveraCrawler... - CrawlConvera ...,http://www.convera.com,
id_a_f_051205_1,ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl),Converas RetrievalWare Internet Spider (63.241.61.x),R, s. also - infoConveraCrawler... - CrawlConvera ...,http://www.convera.com/,
id_a_f_179,ConveraMultiMediaCrawler/0.1 (+http://www.authoritativeweb.com/crawl),Converas RetrievalWare Internet Spider (63.241.61.x),R, s. also - infoConveraCrawler... - CrawlConvera ...,http://www.convera.com,
id_a_f_180,CoolBot,Suchmaschine21 (Germany) robot,R,,http://www.suchmaschine21.de/,
id_a_f_040406_1,CoralWebPrx/0.1.1x (See http://coralcdn.org/),Coral Content Distribution Network,P C,,http://coralcdn.org/,
id_a_f_181,cosmos/0.8_(robot@xyleme.com),Xyleme SA France robot,R,,http://www.xyleme.com/en/index.jsp,
id_a_f_182,cosmos/0.9_(robot@xyleme.com),Xyleme SA France robot,R,,http://www.xyleme.com/en/index.jsp,
id_a_f_040607_1,CoteoNutchCrawler/Nutch-0.9 (info [at] coteo [dot] com),Coteo.com - local French directory link checking,C,,http://www.coteo.com/,
id_a_f_030206_3,CougarSearch/0.x (+http://www.cougarsearch.com/faq.shtml),Cougarsearch.com robot,R,,http://www.cougarsearch.com/,
id_a_f_280408_2,Covac TexAs Arachbot,Covac Arachnid Web Crawler,R,s.also ArachBot,http://www.covac-software.com/,
id_a_f_211208_1,CoverScout%203/3.0.1 CFNetwork/339.5 Darwin/9.5.0 (i386) (iMac5,1),CoverScout for iTunes - CD cover search tool,B,,http://www.equinux.com/de/products/coverscout/index.html,
id_a_f_183,Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com),Naver Japan / Korea robot,R, s. also Python-urllib/1.15 -  nabot -  NaverBot & dloader,http://www.naver.co.jp,
id_a_f_184,Cowbot-0.1.x (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com),Naver Japan / Korea robot,R, s. also Python-urllib/1.15 -  nabot -  NaverBot & dloader,http://www.naver.co.jp,
id_a_f_185,CrawlConvera0.1 (CrawlConvera@yahoo.com),Converas RetrievalWare Internet Spider,R,s. also - Convera Internet Spider .. - infoConveraCrawler...,http://www.convera.com,
id_a_f_186,Crawler,unknown robot via Level3.net,,,,
id_a_f_187,Crawler (cometsearch@cometsystems.com),Cometsystems Comet Search robot via Findwhat (now Miva),R,,http://www.cometsystems.com,http://www.miva.com/
id_a_f_188,Crawler admin@crawler.de,Crawler.de / Abacho robot,R,,http://www.crawler.de,http://www.abacho.de/
id_a_f_189,Crawler V 0.2.x admin@crawler.de,Crawler.de / Abacho robot,R,,http://www.crawler.de,http://www.abacho.de/
id_a_f_190,crawler@alexa.com,Alexa crawler,R,,http://www.alexa.com,
id_a_f_191,CrawlerBoy Pinpoint.com,Pinpoint WAP search robot,R,,http://www.pinpoint.com,
id_a_f_130506_1,Crawllybot/0.1 (Crawllybot; +http://www.crawlly.com; crawler@crawlly.com),Crawlly Beta search - Germany (72.232.194.2xx),R,powered by Nutch,http://www.crawlly.com/,
id_a_f_192,CreativeCommons/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net),Creatice Commons using Nutch open source robot,R,,http://www.nutch.org,
id_a_f_193,CrocCrawler vx.3 [en] (http://www.croccrawler.com) (X11; I; Linux 2.0.44 i686),Croccrawler robot,R,,http://www.croccrawler.com,
id_a_f_090306_2,csci_b659/0.13,Web mining project from CSCI 659 (computer science course) at Indiana Univerity,R,,http://informatics.indiana.edu/fil/Class/b659/,
id_a_f_180906_1,CSE HTML Validator Professional (http://www.htmlvalidator.com/),CSE HTML Validator for Windows,C,,http://www.htmlvalidator.com/,
id_a_f_194,Cuam Ver0.050bx,Cuam - IE based browser,B,site is dead,http://cuam.virtualave.net,
id_a_f_195,Cuasarbot/0.9b http://www.cuasar.com/spider_beta/ ,Cuasar (Spain) music / ringtone search spider,R,,http://www.cuasar.com,
id_a_f_196,curl/7.10.x (i386-redhat-linux-gnu) libcurl/7.10.x OpenSSL/0.9.7a ipv6 zlib/1.1.4,Curl file transferring tool,D,,http://curl.haxx.se/,
id_a_f_197,curl/7.7.x (i386--freebsd4.3) libcurl 7.7.x (SSL 0.9.6) (ipv6 enabled),Curl file transferring tool,D,,http://curl.haxx.se/,
id_a_f_198,curl/7.8 (i686-pc-linux-gnu) libcurl 7.8 (OpenSSL 0.9.6),Curl file transferring tool,D,,http://curl.haxx.se/,
id_a_f_199,curl/7.9.x (win32) libcurl 7.9.x,Curl file transferring tool,D,,http://curl.haxx.se/,
id_a_f_200,CurryGuide SiteScan 1.1,CurryGuide UK link check robot,R,,http://uk.curryguide.com/,
id_a_f_201,Custo x.x (www.netwu.com),Custo web site spidering tool (link checking),C,s. also - - Mozilla/5.0 (compatible; Custo 3...,http://www.netwu.com,
id_a_f_202,Custom Spider www.bisnisseek.com /1.0,Bisnisseek (was www.bisnisseek.com) robot,R,,,
id_a_f_203,Cyberdog/2.0 (Macintosh; 68k),Cyberdog Mac Browser (was www.cyberdog.org),B,,,
id_a_f_260608_2,CyberPatrol SiteCat Webbot (http://www.cyberpatrol.com/cyberpatrolcrawler.asp),CyberPatrol LLC robot for web filtering software,R,38.103.17.16x,http://www.cyberpatrol.com/cyberpatrolcrawler.asp,
id_a_f_204,CyberSpyder Link Test/2.1.12 (admin@mspennyworth.com),CyberSpyder Link Test software,C,,http://www.cyberspyder.com/cslnkts1.html,
id_a_f_205,CydralSpider/1.x (Cydral Web Image Search; http://www.cydral.com),Cydral image & site search spider,R,,http://www.cydral.com,
id_a_f_060508_1,CydralSpider/3.0 (Cydral Image Search; http://www.cydral.com),Cydral image & site search spider,R,,http://www.cydral.com,
id_a_f_206,DA 3.5 (www.lidan.com),Downloadaccelerator download manager,D,,http://www.downloadaccelerator.com,
id_a_f_207,DA 4.0,Downloadaccelerator download manager,D,,http://www.downloadaccelerator.com,
id_a_f_208,DA 4.0 (www.downloadaccelerator.com),Downloadaccelerator download manager,D,,http://www.downloadaccelerator.com,
id_a_f_209,DA 5.0,Downloadaccelerator download manager,D,,http://www.downloadaccelerator.com,
id_a_f_210,DA 7.0,Downloadaccelerator download manager,D,,http://www.downloadaccelerator.com,
id_a_f_070209_3,DAP x.x,Download Accelerator Plus download manager,D,,http://www.speedbit.com/,
id_a_f_211,Dart Communications PowerTCP,PowerTCP ActiveX control tool,,,http://www.dart.com,
id_a_f_212,DataCha0s/2.0,Unknown bot from Kornet Korea (218.149.129.xxx) scans for Perl Awstats,S,,,
id_a_f_101106_1,DataCha0s/2.0,Unknown UA looking for Awstats Perl components,S,from various IPs,,
id_a_f_213,DataFountains/DMOZ Downloader,INFOMINE/iVia Scholary Internet Resource Collections robot,R,138.23.85.xx,http://infomine.ucr.edu/,http://ivia.ucr.edu/useragents.shtml
id_a_f_040307_1,DataFountains/Dmoz Downloader (http://ivia.ucr.edu/useragents.shtml),INFOMINE/iVia Scholary Internet Resource Collections robot,R,138.23.85.xx,http://infomine.ucr.edu/,http://ivia.ucr.edu/useragents.shtml
id_a_f_110307_1,DataFountains/DMOZ Feature Vector Corpus Creator (http://ivia.ucr.edu/useragents.shtml),INFOMINE/iVia Scholary Internet Resource Collections robot,R,138.23.85.xx,http://infomine.ucr.edu/,http://ivia.ucr.edu/useragents.shtml
id_a_f_050907_1,DataparkSearch/4.47 (+http://dataparksearch.org/bot),DataparkSearch open source search engine,R,,http://www.dataparksearch.org,
id_a_f_214,DataparkSearch/4.xx (http://www.dataparksearch.org/),DataparkSearch open source search engine,R,,http://www.dataparksearch.org,
id_a_f_080206_1,DataSpear/1.0 (Spider; http://www.dataspear.com/spider.html; spider@dataspear.com),DataSpear Directory robot (24.109.29.xx),R,,http://www.dataspear.com/,
id_a_f_215,DataSpearSpiderBot/0.2 (DataSpear Spider Bot; http://dssb.dataspear.com/bot.html; dssb@dataspear.com),DataSpear Directory robot (24.109.29.xx),R,,http://www.dataspear.com/,
id_a_f_161105_1,DatenBot( http://www.sicher-durchs-netz.de/bot.html),Sicher-durchs-Netz German security related search (62.75.220.xxx),R,,http://www.sicher-durchs-netz.de/suche,
id_a_f_216,DaviesBot/1.7 (www.wholeweb.net),Wholeweb robot,R,site is closed,http://www.wholeweb.net,
id_a_f_217,daypopbot/0.x,Daypop blog - weblog - online mag search spider,R,,http://www.daypop.com/info/about.htm,
id_a_f_218,dbDig(http://www.prairielandconsulting.com),dbDig search engine,R,,http://www.prairielandconsulting.com,
id_a_f_219,DBrowse 1.4b,Some site scanning tool via diff. IPs i.e.: - wanweb.net (208.6.163.xxx) - cox.net (68.4.xxx.xxx),S,UA sometimes - DSurf15a 01 - DBrowse 1.4d,,
id_a_f_220,DBrowse 1.4d,Some site scanning tool via diff. IPs i.e.: - pacbell.net (67.112.xxx.xxx),S,see also DSurf15a 01 - DBrowse 1.4b,,
id_a_f_221,DC-Sakura/x.xx,DC-Sakura download manager,D,,http://www.dc-sakura.com/,
id_a_f_222,dCSbot/1.1,unknown divine/Openmarket.com robot,R,,http://www.openmarket.com/,
id_a_f_223,DDD,some (website) downloading tool,D,,,
id_a_f_224,dds explorer v1.0 beta,Unknown user agent,,,,
id_a_f_225,de.searchengine.comBot 1.2 (http://de.searchengine.com/spider),Searchengine.com (Germany) submission checking / robot (84.73.57.xx),R,,http://de.searchengine.com,
id_a_f_226,DeadLinkCheck/0.4.0 libwww-perl/5.xx,DLC Perl HTTP link checking,C,,http://dlc.sourceforge.net/,
id_a_f_111206_3,Deep Link Calculator v1.0,Sootle Web Directory deep link checker,C,216.89.111.x,http://directory.sootle.com/deep-links/,
id_a_f_227,deepak-USC/ISI,deepak-USC/ISI robot from USC/Information Science Institute,R,,http://www.isi.edu/%7Eravichan/deepak-usc-isi.html,http://www.isi.edu/
id_a_f_228,DeepIndex,Deepindex robot,R,,http://www.deepindex.net/utilisateurs.php?referral=deepindex,
id_a_f_229,DeepIndex ( http://www.zetbot.com ),Zetbot search Belgium (213.41.128.xx) using Deepindex robot,R,,http://www.zetbot.com/,http://www.deepindex.net/utilisateurs.php?referral=deepindex
id_a_f_230,DeepIndex (www.en.deepindex.com),Deepindex robot,R,,http://www.deepindex.net/utilisateurs.php?referral=deepindex,
id_a_f_231,DeepIndexer.ca,Deepindex robot (via Paragon.net Canada),R,,http://www.deepindex.net/utilisateurs.php?referral=deepindex,
id_a_f_011006_2,del.icio.us-thumbnails/1.0 Mozilla/5.0 (compatible; Konqueror/3.4; FreeBSD) KHTML/3.4.2 (like Gecko),del.icio.us picture robot for thumbnail preview via Yahoo,D,66.94.237.1xx,http://del.icio.us/,
id_a_f_250106_1,DeleGate/9.0.5-fix1,DeleGate application level gateway / proxy server,P,,http://www.delegate.org/delegate/,
id_a_f_232,Demo Bot DOT 16b,Some site scanning tool from 217.34.59.xxx (btopenworld.com),S,,,
id_a_f_233,Demo Bot Z 16b,Some site scanning tool from 68.154.96.xx (bellsouth.net),S,appears also as - MFC Foundation Class Library - Full Web Bot 0516B,,
id_a_f_234,Denmex websearch (http://search.denmex.com),Denmex Websearch robot/link checking,R,,http://search.denmex.com,
id_a_f_235,Der große BilderSauger 2.00u,DataBecker Bilder Sauger (discontinued) web graphics downloader,D,,http://www.databecker.de,
id_a_f_230206_1,dev-spider2.searchpsider.com/1.3b,Searchspider.com robot (72.245.225.xxx),R,,http://www.searchspider.com/,
id_a_f_236,DevComponents.com HtmlDocument Object,DevComponents HTMLDocument Class Library for Visual Studio.net,,,http://www.devcomponents.com,
id_a_f_237,DiaGem/1.1 (http://www.skyrocket.gr.jp/diagem.html),DiaGem Japan web crawler,R,(site is offline),http://www.skyrocket.gr.jp,
id_a_f_238,Diamond/x.0,Claria (ex Gator) SearchScout robot (64.152.73.xx),R,s. also Claria,http://www.searchscout.com,
id_a_f_239,DiamondBot,Claria (ex Gator) SearchScout robot (64.152.73.xx),R,s. also Claria,http://www.searchscout.com,
id_a_f_240,Digger/1.0 JDK/1.3.0rc3,Diggit! robot,R,,http://www.diggit.com,
id_a_f_241,DigOut4U,OpenPortal4U robot,R,,http://www.arisem.com,
id_a_f_242,DIIbot/1.2,Findsame.com (site is offline) / Digital-Integrity robot,R,,http://www.digital-integrity.com/,
id_a_f_100206_1,Dillo/0.8.5-i18n-misc,Dillo Web Browser,B,,http://www.dillo.org/,
id_a_f_243,Dillo/0.x.x,Dillo Web Browser,B,,http://www.dillo.org/,
id_a_f_100109_1,disastrous/1.0.5 (running with Python 2.5.1; http://www.bortzmeyer.org/disastrous.html; archangel77@del.icio.us),disastrous - a del.icio.us link checker based on Python,C,,http://www.bortzmeyer.org/disastrous.html,
id_a_f_140306_1,DISCo Pump x.x,DISCo Pump offline browser / website ripper,D,No active homepage,http://www.arssoft.com/,http://www.filetransit.com/view.php?id=3870
id_a_f_300907_1,disco/Nutch-0.9 (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com),Unkown robot from Discovery Engine Corp.,R,208.96.54.xx,http://www.discoveryengine.com/,
id_a_f_300907_2,disco/Nutch-1.0-dev (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com),Unkown robot from Discovery Engine Corp.,R,208.96.54.xx,http://www.discoveryengine.com/,
id_a_f_244,DittoSpyder,Ditto picture search robot,R,,http://www.ditto.com,
id_a_f_245,dlman,some download agent,D,in conjunction w. "Wildsoft Surfer",,
id_a_f_246,dloader(NaverRobot)/1.0,Naver Japan / Korea robot,R,s. also Python-urllib/1.15 - nabot - NaverBot & Cowbot,http://www.naver.co.jp,
id_a_f_100408_1,DNSRight.com WebBot Link Ckeck Tool. Report abuse to: dnsr@dnsright.com,DNS Right - Online DNS tools,C,203.161.71.17x,http://www.dnsright.com/,
id_a_f_247,DoCoMo/1.0/Nxxxi/c10,NTT DoCoMo (Japan) robot,R,,http://www.nttdocomo.co.jp/,
id_a_f_248,DoCoMo/1.0/Nxxxi/c10/TB,NTT DoCoMo (Japan) robot,R,,http://www.nttdocomo.co.jp/,
id_a_f_249,DoCoMo/1.0/P502i/c10 (Google CHTML Proxy/1.0),Google (216.239.39.x) proxy server,P,,,
id_a_f_250,DoCoMo/2.0 P900iV(c100;TB;W24H11) ,NTT DoCoMo (Japan) robot,R,,http://www.nttdocomo.co.jp/,
id_a_f_141205_1,DoCoMo/2.0 SH901iS(c100;TB;W24H12),gzip(gfe) (via translate.google.com),NTT DoCoMo (Japan) proxy server (210.136.161.1xx),P,,http://www.nttdocomo.co.jp/,
id_a_f_081207_1,DoCoMo/2.0 SH902i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html),Yahoo Search Japan robot (203.216.197.xxx),R,s. also Y!J-SRD/1.0,http://www.yahoo.co.jp/,
id_a_f_271006_3,DoCoMo/2.0/SO502i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html),Yahoo Search Japan robot (203.216.197.xxx),R,s. also Y!J-SRD/1.0,http://www.yahoo.co.jp/,
id_a_f_251,DocZilla/1.0 (Windows; U; WinNT4.0; en-US; rv:1.0.0) Gecko/20020804,DocZilla - Mozilla-based SGML/XML/HTML- browser,B,,http://www.doczilla.com,
id_a_f_210607_1,dodgebot/experimental,unknown robot from AGMLAB Information Technologies (Information retrieval system ?),R,212.174.130.1xx,http://www.agmlab.com/agmlab_eng.html,
id_a_f_180606_1,DonutP; Windows98SE,Donut P - Japanese IE based browser,B,,http://donutp.com/,
id_a_f_250907_2,Doubanbot/1.0 (bot@douban.com http://www.douban.com),Unknown robot from douban search (China) - maybe image crawling,,59.151.41.xx,http://www.douban.com/,
id_a_f_252,Download Demon/3.x.x.x,Download Demon/Netzip download manager,D,,http://www.netzip.com,
id_a_f_191105_4,Download Druid 2.x,Download Druid IE plugin download manager,D,,http://www.xemico.com/druid/index.html,
id_a_f_253,Download Express 1.0,Download Express download manager,D,,http://www.metaproducts.com,
id_a_f_254,Download Master,Download Master download manager,D,,http://www.westbyte.com/dm/index.phtml,
id_a_f_191105_5,Download Ninja 3.0,Download Ninja download manager (Japan),D,,http://www.h-fd.org/mkro/mt/archives/2002/09/download_ninja_1.html,
id_a_f_255,Download Wonder,Download Wonder download manager,D,,http://www.forty.com,
id_a_f_256,Download-Tipp Linkcheck (http://download-tipp.de/),Download-Tipp Germany link checking,R,,http://download-tipp.de/,
id_a_f_257,Download.exe(1.1) (+http://www.sql-und-xml.de/freeware-tools/),download.exe .NET based downloading tool,D,,http://www.sql-und-xml.de/freeware-tools/,
id_a_f_300907_3,DownloadDirect.1.0,Download Direct download manager,D,,http://senbit.com/,
id_a_f_258,Dr.Web (R) online scanner: http://online.drweb.com/,Dr.WEB online virus scanner,,,http://online.drweb.com,
id_a_f_259,Dragonfly File Reader,Dragonfly CMS - Open Source content management system,B,,http://www.cpgnuke.com,
id_a_f_260,Drecombot/1.0 (http://career.drecom.jp/bot.html),Drecom Japan (210.233.67.xxx) - Blog search ??,R,,http://www.drecom.co.jp,
id_a_f_3090906_1,Drupal (+http://drupal.org/),Drupal - open source content management platform,C,,http://drupal.org/,
id_a_f_261,DSurf15a 01,Some site scanning tool via diff. IPs i.e.: - cox.net (68.5.xxx.xxx) - pacbell.net (64.16x.xxx.xxx),S,UA sometimes "DBrowse 1.4d",,
id_a_f_262,DSurf15a 71,Some site scanning tool via diff. IPs i.e.: - cox.net (68.4.xxx.xxx),S,UA sometimes PBrowse 1.4b or DBrowse x.xx or random letters like "TRPMFHXE",,
id_a_f_263,DSurf15a 81,Some site scanning tool via diff. IPs i.e.: - verizon.net (4.47.xxx.xxx),S,UA sometimes random letters like "WFRIKXVNFL",,
id_a_f_264,DSurf15a VA,Some site scanning tool via diff. IPs i.e.: - eastlink.ca (24.222.xxx.xxx) - cogeco.net (216.221.8x.xxx),S,,,
id_a_f_020506_2,DTAAgent,DTAAgent Java object for data collecting,R D,,http://www.ibr.cs.tu-bs.de/courses/ss00/sep-vs/gruppe1/jdoc/DTA/agent/DTAAgent.html,
id_a_f_265,dtSearchSpider,dt Search Spider software,R,,http://www.dtsearch.com/spider.html,
id_a_f_266,Dual Proxy,Fourelle Venturi proxy server,P,,http://www.fourelle.com/news/articles/148457.htm,
id_a_f_290308_2,DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html),Duck Duck Go search crawler,R,72.94.249.34,http://duckduckgo.com/,http://duckduckgo.com/duckduckbot.html
id_a_f_267,Dumbot(version 0.1 beta - dumbfind.com),DumbFind.com robot,R,,http://www.dumbfind.com,
id_a_f_268,Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html),DumbFind.com robot,R,,http://www.dumbfind.com,
id_a_f_269,Dumbot(version 0.1 beta),DumbFind.com robot,R,,http://www.dumbfind.com,
id_a_f_270,e-sense 1.0 ea(www.vigiltech.com/esensedisclaim.html),Vigiltech e-Sense user research robot (website is offline),R,,,
id_a_f_271,e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/),e-Society Project (Japan) crawler (133.9.238.xx),R,,http://www.yama.info.waseda.ac.jp,
id_a_f_280108_1,eApolloBot/2.0 (compatible; heritrix/2.0.0-SNAPSHOT-20071024.170148 +http://www.eapollo-opto.com),Global Opto's eApollo Flash based search engine - Taiwan,R,,http://www.eapollo.com/eaSE.jsp?language=eng,http://www.global-opto.com/
id_a_f_272,EARTHCOM.info/1.x [www.earthcom.info],Earthcom (Czech Republic) search robot (194.108.39.xx),R,s. also Mozilla/5.0 (compatible; EARTHCOM.info/2.01 ...,http://www.earthcom.info,
id_a_f_273,EARTHCOM.info/1.xbeta [www.earthcom.info],Earthcom (Czech Republic) search robot (194.108.39.xx),R,s. also Mozilla/5.0 (compatible; EARTHCOM.info/2.01 ...,http://www.earthcom.info,
id_a_f_274,EasyDL/3.xx,Keywen Encyclopedia Bot,R,,http://keywen.com/Encyclopedia/Bot/,
id_a_f_275,EasyDL/3.xx http://keywen.com/Encyclopedia/Bot,Keywen Encyclopedia Bot,R,,http://keywen.com/Encyclopedia/Bot/,
id_a_f_276,EBrowse 1.4b,Some site scanning tool via diff. IPs i.e.: - swbell.net (65.66.xxx.xxx),S,,,
id_a_f_277,eCatch/3.0,eCatch (now Wysigot) offline browser,B D,,http://www.ecatch.com,
id_a_f_278,EchO!/2.0,Echo.fr robot,R,,http://echo.fr/,
id_a_f_279,Educate Search VxB,Some site scanning tool via diff. IPs i.e.: - cox.net (68.4.xxx.xxx),S,s. also DSurf - 66.118.1xx.xxx (sagonet.com) - see also Full Web Bot - Industry Program 1.0.5,,
id_a_f_280,egothor/3.0a (+http://www.xdefine.org/robot.html),Xdefine text search engine robot - based on Egothor open source crawler,R,,http://www.xdefine.com/,http://www.egothor.org/
id_a_f_281,EgotoBot/4.8 (+http://www.egoto.com/about.htm),Egoto Search robot,R,,http://www.egoto.com,
id_a_f_211105_1,ejupiter.com,eJupiter searcg robot (206.191.49.xx),R,,http://search.ejupiter.com/,
id_a_f_282,EldoS TimelyWeb/3.x,TimelyWeb web page monitoring tool,C,s. also TimelyWeb/...,http://www.eldos.org/timelyweb/timelyweb.html,
id_a_f_283,elfbot/1.0 (+http://www.uchoose.de/crawler/elfbot/),Elftales crawler for uChoose theme based search (Germany),R,,http://www.uchoose.de,
id_a_f_300707_1,ELI/20070402:2.0 (DAUM RSS Robot, Daum Communications Corp.; +http://ws.daum.net/aboutkr.html),DAUMOA - RSS search robot of Daum,R,211.115.109.1xx,http://ws.daum.net/abouten.html,
id_a_f_284,ELinks (0.x.x; Linux 2.4.20 i586; 132x60),ELinks text mode browser,B,,http://elinks.or.cz/,
id_a_f_285,ELinks/0.x.x (textmode; NetBSD 1.6.2 sparc; 132x43),ELinks text mode browser,B,,http://elinks.or.cz/,
id_a_f_286,EmailSiphon,Sonic E-mail collector,S,,http://www.americaint.com/superstore/elist.html,
id_a_f_220508_2,EmailSpider,EmailSpider E-mail harvesting  software,S,,http://www.emailspider.net/index.php?kat=11,
id_a_f_287,EmailWolf 1.00,Trellian EMailWolf E-mail collector,S,,http://www.trellian.com,
id_a_f_288,EmeraldShield.com WebBot,EmeraldShield spam and web filtration services,P R,,http://www.emeraldshield.com,
id_a_f_289,EmeraldShield.com WebBot (http://www.emeraldshield.com/webbot.aspx),EmeraldShield spam and web filtration services,P R,,http://www.emeraldshield.com,
id_a_f_070606_2,EMPAS_ROBOT,Empas search Korea robot (220.95.22x.xxx),R,,http://www.empas.com/,
id_a_f_280208_1,EnaBot/1.x (http://www.enaball.com/crawler.html),Enabot - Enaball semantic search project crawler,R,,http://www.enaball.com/crawler.html,
id_a_f_110506_4,endo/1.0 (Mac OS X; ppc i386; http://kula.jp/endo),endo - Mac news site and blog aggregator,B,,http://kula.jp/software/endo/,
id_a_f_290,Enfish Tracker,Enfish Personal search tool,R,,http://www.enfish.com,
id_a_f_291,Enterprise_Search/1.0,Enterprise Search engine software (64.202.165.xxx),R, s. also - ES.NET_Crawler - InnerpriseBot,http://www.innerprise.net,
id_a_f_292,Enterprise_Search/1.0.xxx,Enterprise Search engine software (64.202.165.xxx),R, s. also - ES.NET_Crawler - InnerpriseBot,http://www.innerprise.net,
id_a_f_293,Enterprise_Search/1.00.xxx;MSSQL (http://www.innerprise.net/es-spider.asp),Enterprise Search engine software (64.202.165.xxx),R, s. also - ES.NET_Crawler - InnerpriseBot,http://www.innerprise.net,
id_a_f_230706_1,envolk/1.7 (+http://www.envolk.com/envolkspiderinfo.php),Envolk Web Search robot,R,70.169.191.x,http://www.envolk.com/,
id_a_f_294,envolk[ITS]spider/1.6(+http://www.envolk.com/envolkspider.html),Envolk Web Search robot,R,70.169.191.x,http://www.envolk.com/,
id_a_f_295,EroCrawler,EroCrawler adult search robot,R,,http://www.erocrawler.com,
id_a_f_296,ES.NET_Crawler/2.0 (http://search.innerprise.net/),Enterprise Search engine software (64.202.165.xxx),R,s. also - Enterprise_Search - InnerpriseBot,http://search.innerprise.net,
id_a_f_297,eseek-larbin_2.6.2 (crawler@exactseek.com),ExactSEEK (Jayde Online) robot,R,see also ExactSeek Crawler / eseek-larbin / exactseek.com,http://www.exactseek.com,
id_a_f_298,ESISmartSpider,ESI Smart-Spider toolkit,R,,http://www.smart-spider.com/,
id_a_f_299,eStyleSearch 4 (compatible; MSIE 6.0; Windows NT 5.0),e-Style ISP search (Russia) robot (217.174.103.xxx),R,,http://www.e-styleisp.ru/,
id_a_f_300,ESurf15a 15,Some site scanning tool via diff. IPs,S,s. also DSurf - PBrowse ...,,
id_a_f_301,EuripBot/0.x (+http://www.eurip.com) GetFile,Eurip.com - European Internet Portal robot,R,,http://www.eurip.com,
id_a_f_302,EuripBot/0.x (+http://www.eurip.com) GetRobots,Eurip.com - European Internet Portal robot,R,,http://www.eurip.com,
id_a_f_303,EuripBot/0.x (+http://www.eurip.com) PreCheck,Eurip.com - European Internet Portal robot,R,,http://www.eurip.com,
id_a_f_220508_3,Eurobot/1.0 (http://www.ayell.eu),Ayell Euronet business directory robot,R,,http://www.ayell.eu/,
id_a_f_030206_4,EvaalSE - bot@evaal.com,Evaal Search Engine robot,R,based on Nutch,http://www.evaal.com/,http://search.evaal.com/en/about.html
id_a_f_304,eventax/1.3 (eventax; http://www.eventax.de/; info@eventax.de),Eventax event search (Germany),R,,http://www.eventax.de,
id_a_f_291205_1,Everest-Vulcan Inc./0.1 (R&D project; host=e-1-24; http://everest.vulcan.com/crawlerhelp),Vulcan Inc. Everest crawler (in development),R,,http://www.vulcan.com/,
id_a_f_305,Everest-Vulcan Inc./0.1 (R&D project; http://everest.vulcan.com/crawlerhelp),Vulcan Inc. Everest crawler (in development),R,,http://www.vulcan.com/,
id_a_f_050406_2,Exabot-Images/1.0,Exalead Websearch image crawler (193.47.80.xx),R,Exabot-Images only requests robots.txt - image crawling under UA NG/4.0.1229,http://www.exalead.com/search,
id_a_f_211206_1,Exabot-Test/1.0,Exalead (France) search robot (193.47.80.xx),R,s. Harvest-NG/1.0.2 and Exalead NG...,http://www.exabot.com/,
id_a_f_190106_1,Exabot/2.0,Exalead (France) search robot (193.47.80.xx),R,s. Harvest-NG/1.0.2 and Exalead NG...,http://www.exabot.com/,
id_a_f_211206_2,Exabot/3.0,Exalead (France) search robot (193.47.80.xx),R,s. Harvest-NG/1.0.2 and Exalead NG...,http://www.exabot.com/,
id_a_f_306,ExactSearch,eXact Search Bar for IE,B,,http://www.exactsearchbar.com/exact04,
id_a_f_307,ExactSeek Crawler/0.1,ExactSEEK (Jayde Online) robot,R,see also eseek-larbin / exactseek.com,http://www.exactseek.com,
id_a_f_308,exactseek-crawler-2.63 (crawler@exactseek.com),ExactSEEK (Jayde Online) robot,R,see also eseek-larbin / exactseek.com,http://www.exactseek.com,
id_a_f_309,exactseek-pagereaper-2.63 (crawler@exactseek.com),ExactSEEK (Jayde Online) robot,R,see also eseek-larbin / exactseek.com,http://www.exactseek.com,
id_a_f_050606_2,exactseek.com,ExactSEEK (Jayde Online) robot (69.9.181.1xx),R,see also eseek-larbin,http://www.exactseek.com,
id_a_f_310,Exalead NG/MimeLive Client (convert/http/0.120),Exalead (France) search robot (193.47.80.xx),R,s. Harvest-NG/1.0.2 and NG/1.0,http://www.exabot.com,
id_a_f_311,Excalibur Internet Spider V6.5.4,Excalibur (now Convera) spider software,R,,http://www.excalib.com,
id_a_f_191206_1,Execrawl/1.0 (Execrawl; http://www.execrawl.com/; bot@execrawl.com),Execrawl software search using nutch,R,72.36.179.1xx,http://www.execrawl.com/,
id_a_f_060608_1,exooba crawler/exooba crawler (crawler for exooba.com; http://www.exooba.com/; info at exooba dot com),exooba crawler for exooba search pre-alpha development,R,216.195.184.xx,http://www.exooba.com/,
id_a_f_060608_2,exooba/exooba crawler (exooba; exooba),exooba crawler for exooba search pre-alpha development,R,216.195.184.xx,http://www.exooba.com/,
id_a_f_312,ExperimentalHenrytheMiragoRobot,Mirago UK Robot,R,,http://www.mirago.co.uk,
id_a_f_313,Expired Domain Sleuth,Expired Domain Sleuth domain name tool,R C,,http://expireddomainsleuth.com/,
id_a_f_314,Express WebPictures (www.express-soft.com),Express Web Pictures image browser,B D,,http://www.express-soft.com/,
id_a_f_315,ExtractorPro,Extractor Pro e-mail collector,S,,http://www.extractorpro.com,
id_a_f_170106_1,Extreme Picture Finder,Exisoftware image grabber and downloading tool,D,,http://www.exisoftware.com/picture_finder/,
id_a_f_316,EyeCatcher (Download-tipp.de)/1.0,Download-Tipp Germany robot,R,,http://download-tipp.de,
id_a_f_091006_1,Factbot 1.09 (see http://www.factbites.com/webmasters.php),Factbites search robot,R,70.86.159.1xx,http://www.factbites.com/,
id_a_f_220906_1,factbot : http://www.factbites.com/robots,Factbites search robot,R,70.86.159.1xx,http://www.factbites.com/,
id_a_f_221006_1,FaEdit/2.0.x,FaEdit Professional - Japanese bookmark manager,C,,https://sw.vector.co.jp/swreg/step1.reserve?srno=SR040433&site=y,
id_a_f_317,FairAd Client,FairAd user,P,,http://www.fairad.de,
id_a_f_051206_1,FANGCrawl/0.01,Safe-t.net web filtering service,P,63.167.160.1xx,http://www.safe-t.net/,
id_a_f_210206_1,FARK.com link verifier,Drew Curtis' FARK.com link checking,C,,http://www.fark.com/,
id_a_f_318,Fast Crawler Gold Edition,Fast/Alltheweb crawler (66.151.181.xx),R,,http://www.alltheweb.com,
id_a_f_319,FAST Enterprise Crawler 6 (Experimental),Fast/Alltheweb crawler (66.151.181.xx),R,,http://www.alltheweb.com,
id_a_f_040206_1,FAST Enterprise Crawler 6 / Scirus scirus-crawler@fast.no; http://www.scirus.com/srsapp/contactus/,Fast Enterprise Crawler (66.151.181.xx) for Scirus scienctific information search,R,,http://www.scirus.com/srsapp/,http://www.alltheweb.com
id_a_f_320,FAST Enterprise Crawler 6 used by Cobra Development (admin@fastsearch.com),Fast/Alltheweb crawler (66.151.181.xx),R,,http://www.alltheweb.com,
id_a_f_070507_1,FAST Enterprise Crawler 6 used by Comperio AS (sts@comperio.no),Comperio Web Miner based on Fast ESP,R,,http://www.comperio.no/index.php?option=com_content&task=blogcategory&id=7&Itemid=27,
id_a_f_321,FAST Enterprise Crawler 6 used by FAST (FAST),Fast/Alltheweb crawler (66.151.181.xx),R,,http://www.alltheweb.com,
id_a_f_161106_1,FAST Enterprise Crawler 6 used by Pages Jaunes (pvincent@pagesjaunes.fr),Pages Jaunes business search (France) robot using Fast Enterprise Crawler,R,193.252.242.xx,http://www.pagesjaunes.fr/,
id_a_f_322,FAST Enterprise Crawler 6 used by Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au),Fast/Alltheweb crawler for Sensis.com.au Australian search (66.151.181.xx),R,,http://www.sensis.com.au/,http://www.alltheweb.com
id_a_f_251007_2,FAST Enterprise Crawler 6 used by Singapore Press Holdings (crawler@sphsearch.sg),SPH Search - Singapore related search using Fast crawler,R,202.176.220.xx,http://www.sphsearch.sg/,
id_a_f_280606_2,FAST Enterprise Crawler 6 used by WWU (wardi@uni-muenster.de),FAST Enterprise Crawler  used by WWU (University of Muenster - Germany),C,128.176.188.2xx,http://www.uni-muenster.de/en/index.html,http://www.alltheweb.com
id_a_f_323,FAST Enterprise Crawler/6 (www.fastsearch.com),Fast/Alltheweb crawler (66.151.181.xx),R,,http://www.alltheweb.com,
id_a_f_324,FAST Enterprise Crawler/6.4 (helpdesk at fast.no),Fast/Alltheweb crawler (66.151.181.xx),R,,http://www.alltheweb.com,
id_a_f_325,FAST FirstPage retriever (compatible; MSIE 5.5; Mozilla/4.0),Fast/Alltheweb crawler (66.151.181.xx),R,,http://www.alltheweb.com,
id_a_f_326,FAST MetaWeb Crawler (helpdesk at fastsearch dot com),Fast/Alltheweb crawler (66.151.181.xx),R,,http://www.alltheweb.com,
id_a_f_327,Fast PartnerSite Crawler,Fast/Alltheweb crawler (66.151.181.xx),R,,http://www.alltheweb.com,
id_a_f_328,FAST-WebCrawler/2.2.10 (Multimedia Search) (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html),Fast/Alltheweb multimedia crawler,R,see also Yahoo-MMCrawler/3.x,http://www.alltheweb.com,
id_a_f_329,FAST-WebCrawler/2.2.6 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_330,FAST-WebCrawler/2.2.7 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)http://www.fast.no,Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_331,FAST-WebCrawler/2.2.8 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)http://www.fast.no,Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_332,FAST-WebCrawler/3.2 test,Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_333,FAST-WebCrawler/3.3 (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_334,FAST-WebCrawler/3.4/Nirvana (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_335,FAST-WebCrawler/3.4/PartnerSite (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_336,FAST-WebCrawler/3.5 (atw-crawler at fast dot no; http://fast.no/support.php?c=faqs/crawler),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_337,FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_338,FAST-WebCrawler/3.6/FirstPage (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_339,FAST-WebCrawler/3.7 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_340,FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_341,FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_342,FAST-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp),Fast/Alltheweb crawler,R,,http://www.alltheweb.com,
id_a_f_343,FAST-WebCrawler/3.x Multimedia,Fast/Alltheweb multimedia crawler,R,see also Yahoo-MMCrawler/3.x,http://www.alltheweb.com,
id_a_f_344,FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no),Fast/Alltheweb multimedia crawler,R,see also Yahoo-MMCrawler/3.x,http://www.alltheweb.com,
id_a_f_121205_2,fastbot crawler beta 2.0 (+http://www.fastbot.de),Fastbot search Germany crawler (80.252.104.1xx),R,,http://www.fastbot.de/,
id_a_f_345,FastBug http://www.ay-up.com,Ay-Up geo sync search robot,R,,http://www.ay-up.com,
id_a_f_346,FastCrawler 3.0.1 (crawler@1klik.dk),Fast/Alltheweb crawler (66.151.181.xx),R,,http://www.alltheweb.com,
id_a_f_347,FastSearch Web Crawler for Verizon SuperPages (kevin.watters@fastsearch.com),Fast/Alltheweb crawler used by SuperPages.com,R,,http://www.superpages.com,http://www.alltheweb.com
id_a_f_170408_3,Favcollector/2.0 (info@favcollector.com http://www.favcollector.com/),Favcollector Favicon collecting robot,R,66.207.217.13x,http://www.favcollector.com/,
id_a_f_161006_1,FavIconizer,FavIconizer - IE favorites icons refreshing tool,D,,http://www.codeproject.com/tools/faviconizer.asp,
id_a_f_151206_1,favo.eu crawler/0.6 (http://www.favo.eu),favo.eu (Germany) search robot,R,84.19.186.1xx,http://www.favo.eu/,
id_a_f_348,FavOrg,ZD's FavOrg favourites managing program,C,,http://www.pcmag.com/article2/0,4149,108438,00.asp,
id_a_f_260108_1,Favorites Checking (http://campulka.net),Campulka.net Favorites checking tool,C,,http://campulka.net/?dir=Utility,
id_a_f_349,Favorites Sweeper v.2.03,Favorites Sweeper bookmark checker,C,,http://www.manitoolssoftware.cjb.net,
id_a_f_350,Faxobot/1.0,FaXo Search robot (69.152.89.xx),R,,http://www.faxo.com,
id_a_f_351,FDM 1.x,Free Download Manager (FDM) download accelerator ,D,,http://www.freedownloadmanager.org,
id_a_f_180207_1,FDM 2.x,Free Download Manager (FDM) download accelerator ,D,,http://www.freedownloadmanager.org,
id_a_f_352,Feed Seeker Bot (RSS Feed Seeker http://www.MyNewFavoriteThing.com/fsb.php),RSS Feed Seeker bot (68.225.95.2xx),R,,http://www.MyNewFavoriteThing.com,
id_a_f_241206_1,Feed24.com,Feed24 news feed and blog search,R,194.105.139.2xx,http://www.feed24.com/,
id_a_f_050306_1,Feed::Find/0.0x,Feed::Find - Syndication feed (RSS/Atom) auto-discovery,D,,http://search.cpan.org/~btrott/Feed-Find-0.06/lib/Feed/Find.pm,
id_a_f_250707_1,Feedable/0.1 (compatible; MSIE 6.0; Windows NT 5.1),Feedable beta web based RSS service,B,64.27.19.25x,http://reader.feedable.com/,
id_a_f_230406_2,FeedChecker/0.01,Unknown robot from the University of Tokyo (157.82.157.xx),R,reads robots.txt,http://www.u-tokyo.ac.jp/index_e.html,
id_a_f_140608_2,FeedDemon/2.7 (http://www.newsgator.com/; Microsoft Windows XP),FeedDemon RSS reader,B,,http://www.newsgator.com/individuals/feeddemon/,
id_a_f_160308_2,Feedfetcher-Google-iGoogleGadgets; (+http://www.google.com/feedfetcher.html),Google news feed feetcher for iGoogle gadgets,C,72.14.[1-2]xx.[X]xx,http://www.google.com/feedfetcher.html,
id_a_f_010906_1,Feedfetcher-Google; (+http://www.google.com/feedfetcher.html),Google Feedfetcher - RSS and Atom feed crawler,R,72.14.199.x[xx],http://www.google.com/feedfetcher.html,
id_a_f_010307_1,FeedForAll rss2html.php v2,FeedForAll RSS feed robot,C,216.92.192.1xx,http://www.feedforall.com/,
id_a_f_010308_1,FeedHub FeedDiscovery/1.0 (http://www.feedhub.com),FeedHub news feed personalization engine powered by mSpoke,R,216.134.194.xx,http://www.feedhub.com/,http://www.mspoke.com/
id_a_f_060608_3,FeedHub MetaDataFetcher/1.0 (http://www.feedhub.com),FeedHub news feed personalization engine powered by mSpoke,R,216.134.194.xx,http://www.feedhub.com/,http://www.mspoke.com/
id_a_f_260608_3,Feedjit Favicon Crawler 1.0,Feedjit news feed service favicon crawler,R,69.46.36.x,http://feedjit.com/,
id_a_f_150108_1,Feedreader 3.xx (Powered by Newsbrain),Newsbrain Feedreader3,B,,http://www.feedreader.com/,
id_a_f_281106_3,Feedshow/x.0 (http://www.feedshow.com; 1 subscriber),FeedShow online RSS feed reader,B,,http://www.feedshow.com/,
id_a_f_051206_2,FeedshowOnline (http://www.feedshow.com),FeedShow online RSS feed reader,B,,http://www.feedshow.com/,
id_a_f_021206_1,Feedster Crawler/3.0; Feedster, Inc.,Feedster RSS feed search,R,64.95.116.x[x],http://www.feedster.com/,
id_a_f_040207_1,FeedZcollector v1.x (Platinum) http://www.feeds4all.com/feedzcollector,FeedZcollector - Feed (RSS, ATOM and RDF) capturing software,B,,http://www.feeds4all.com/feedzcollector/,
id_a_f_353,Felix - Mixcat Crawler (+http://mixcat.com),MixCat robot,R,s. also Morris,http://mixcat.com,
id_a_f_354,fetch libfetch/2.0,FreeBSD download tool,D,,,
id_a_f_355,FFC Trap Door Spider,Frequent Finders spider via Sitefusion.com,R,,http://www.frequentfinders.com,
id_a_f_356,Filangy/0.01-beta (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com),Filangy search and bookmark service,R C,,http://www.filangy.com,
id_a_f_357,Filangy/1.0x (Filangy; http://www.filangy.com/filangyinfo.jsp?inc=robots.jsp; filangy-agent@filangy.com),Filangy search and bookmark service,R C,,http://www.filangy.com,
id_a_f_358,Filangy/1.0x (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com),Filangy search and bookmark service,R C,,http://www.filangy.com,
id_a_f_359,fileboost.net/1.0 (+http://www.fileboost.net),File Boost Network link checking,R C,,http://www.fileboost.net,
id_a_f_360,FileHound x.x,FileHound download manager,D,,http://www.allabout.com,
id_a_f_180208_1,Filtrbox/1.0,filtrbox media content (news) monitoring,R,72.47.203.8x,http://www.filtrbox.com/,
id_a_f_361,FindAnISP.com_ISP_Finder_v99a,Find An ISP robot,R C,site is down,http://www.findanisp.com/,
id_a_f_141205_2,Findexa Crawler (http://www.findexa.no/gulesider/article26548.ece),Yelo.no business search (Norway) via Findexa,R,,http://www.findexa.no/english/article27709.ece,
id_a_f_362,findlinks/x.xxx (+http://wortschatz.uni-leipzig.de/findlinks/) ,NextLinks - German vocabulary and hyperlink search,R,,http://wortschatz.uni-leipzig.de/nextlinks/findlinks.html,
id_a_f_363,FineBot,Finesearch robot,R,,http://www.finesearch.com,
id_a_f_080306_1,Finjan-prefetch,Finjan Vital Security Web Appliance security solution,P,,http://www.finjan.com/,
id_a_f_364,Firefly/1.0,Fireball.de robot,R,,http://www.fireball.de,
id_a_f_365,Firefly/1.0 (compatible; Mozilla 4.0; MSIE 5.5),Fireball.de robot,R,,http://www.fireball.de,
id_a_f_210906_1,Firefox (kastaneta03@hotmail.com),Unknown robot from Czech Technical University Prague (147.32.141.xx),R,reads robots.txt,http://www.cvut.cz/,
id_a_f_190306_2,Firefox_1.0.6 (kasparek@naparek.cz),Unknown robot from Czech Technical University Prague (147.32.141.xx),R,reads robots.txt,http://www.cvut.cz/,
id_a_f_366,FirstGov.gov Search - POC:firstgov.webmasters@gsa.gov,AT&T/Fast Search robot for FirstGov (U.S.Government) portal,R,,http://www.firstgov.gov,
id_a_f_367,firstsbot,Firstsfind Germany robot / link checking,R,,http://www.firstsfind.de,
id_a_f_020906_1,Flapbot/0.7.2 (Flaptor Crawler; http://www.flaptor.com; crawler at flaptor period com),Flaptor information retrieval solutions robot,R,,http://www.flaptor.com/index.htm,
id_a_f_368,FlashGet,JetCar/FlashGet download manager,D,,http://www.amazesoft.com,
id_a_f_161205_1,FLATARTS_FAVICO,FlatArts Favorites Icon Tool,C D,,http://flatarts.jp/contents/software/information.php?name=rico,
id_a_f_100308_1,Flexum spider,Flexum.ru search service,R,81.176.76.93,http://www.flexum.ru/,
id_a_f_280508_2,Flexum/2.0,Flexum.ru search service,R,81.176.76.93,http://www.flexum.ru/,
id_a_f_369,FlickBot 2.0 RPT-HTTPClient/0.3-3,DivX.com Movie Find robot,R,,http://www.divx.com,
id_a_f_370,flunky,Metacarta / Cogent robot,R,,http://www.metacarta.com,
id_a_f_371,fly/6.01 libwww/4.0D,unknown,,,,
id_a_f_110107_1,flyindex.net 1.0/http://www.flyindex.net,FLY Index Metasearch link checking,C,62.141.52.2xx,http://www.flyindex.net/,
id_a_f_021108_1,FnooleBot/2.5.2 (+http://www.fnoole.com/addurl.html),Fnoole news crawler,R,209.205.65.9x,http://www.fnoole.com/,
id_a_f_372,FocusedSampler/1.0,IBM's Almaden Research robot,R, s. also: - - WFARC,http://www.almaden.ibm.com,
id_a_f_080108_1,Folkd.com Spider/0.1 beta 1 (www.folkd.com),folkd.com social search robot,R,212.227.95.3x,http://www.folkd.com/,
id_a_f_070209_4,FollowSite Bot ( http://www.followsite.com/bot.html ),FollowSite robot - website monitoring,C,77.232.77.13x,http://www.followsite.com/bot.html,
id_a_f_140209_1,FollowSite.com ( http://www.followsite.com/b.html ),FollowSite robot - website monitoring,C,77.232.77.13x,http://www.followsite.com/bot.html,
id_a_f_141105_1,Fooky.com/ScorpionBot/ScoutOut; http://www.fooky.com/scorpionbots,Fooky search Scorpionbots robot (65.12.170.xxx),R,,http://www.fooky.com/,
id_a_f_373,Francis/1.0 (francis@neomo.de http://www.neomo.de/),Neomo Search (Germany) robot (85.10.197.1xx),R,,http://www.neomo.de,
id_a_f_374,Franklin Locator 1.8,Some spam bot,S,,,
id_a_f_110506_1,free-downloads.net download-link validator /0.1,Free Downloads shareware directory link checking,C,,http://www.free-downloads.net/,
id_a_f_375,FreeFind.com-SiteSearchEngine/1.0 (http://freefind.com; spiderinfo@freefind.com),FreeFind.com robot,R,,http://freefind.com,
id_a_f_221008_2,Frelicbot/1.0 +http://www.frelic.com/,Frelics backlink checking bot (beta),C,,http://www.frelic.com/,
id_a_f_376,FreshDownload/x.xx,Fresh Download download manager,D,,http://www.freshdevices.com,
id_a_f_230306_2,FreshNotes crawler< report problems to crawler-at-freshnotes-dot-com,FreshNotes - music related artist search (72.3.225.xx),R,,http://freshnotes.com/fn/,
id_a_f_377,FSurf15a 01,Some site scanning tool via diff. IPs,S,s. also DSurf -  PBrowse ...,,
id_a_f_070209_5,FTB-Bot http://www.findthebest.co.uk/,Find the Best search robot,R,83.105.71.16x,http://www.findthebest.co.uk/,
id_a_f_378,Full Web Bot 0416B,Some site scanning tool from diff. IPs i.e.: - 66.28.240.xx (cogentco.com) - 68.5.174.xx (cox.net),S,,,
id_a_f_379,Full Web Bot 0516B,Some site scanning tool i.e. from - 68.154.96.xx (bellsouth.net),S,appears also as MFC Foundation Class Library & Demo Bot Z 16b - 66.118.1xx.xxx (sagonet.com) - s. also Educate Search VxB - Industry Program 1.0.5,,
id_a_f_380,Full Web Bot 2816B,Some site scanning tool from 66.255.6.xxx (uslec.com),S,,,
id_a_f_190807_1,FuseBulb.Com,FuseBulb search,R,208.109.126.1xx,http://www.fusebulb.com/,
id_a_f_381,FyberSpider (+http://www.fybersearch.com/fyberspider.php),FyberSearch FyberSpider robot,R,,http://www.fybersearch.com,
id_g_m_382,Gagglebot,Some user from bbnplanet.net (4.63.218.2xx) using an Innerprise robot tool,R C ?,,http://www.innerprise.net,
id_g_m_383,GAIS Robot/1.0B2,Seed Search robot,R,,http://www.seed.net.tw,
id_g_m_384,Gaisbot/3.0 (indexer@gais.cs.ccu.edu.tw; http://gais.cs.ccu.edu.tw/robot.php),Gaislab Taiwan robot,R,140.123.100.x,http://gais.cs.ccu.edu.tw,
id_g_m_160706_1,Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php),Gaislab Taiwan robot,R,140.123.100.x,http://gais.cs.ccu.edu.tw,
id_g_m_385,GalaxyBot/1.0 (http://www.galaxy.com/galaxybot.html),Galaxy robot (63.121.41.xxx),R, s. also Mozilla/4.0 (compatible; MSIE 5.0; www.galaxy.com....),http://www.galaxy.com,
id_g_m_130407_2,Gallent Search Spider v1.4 Robot 2 (http://robot.GallentSearch.com),Gallent Search directory (UK),R,88.208.223.xx,http://www.gallent.co.uk/,http://robot.gallentsearch.com/
id_g_m_010107_1,gamekitbot/1.0 (+http://www.uchoose.de/crawler/gamekitbot/),Gamekit game search engine - Germany,R,80.65.45.xx,http://www.gamekit.de/,
id_g_m_386,Gamespy_Arcade,GameSpyHTTP/1.0,D,GameSpy Arcade download manager (FilePlanet),http://www.gamespyarcade.com/features/,
id_g_m_387,GammaSpider/1.0,GammaWare GammaSpider,R,,http://www.gammasite.com,
id_g_m_388,gazz/x.x (gazz@nttrd.com),nttrd.com / Infobee.ne.jp robot,R,,,
id_g_m_389,geckobot,Geckobot user robot,,no active website,http://www.geckobot.com/,
id_g_m_280406_1,Generic Mobile Phone (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html),Google Mobile Search crawler,R P,66.249.72.1xx,http://www.google.com/mobile/formats.html,
id_g_m_390,generic_crawler/01.0217/,Unknown robot from Carnegie Mellon University (128.2.211.xxx),R,,http://www.cmu.edu,
id_g_m_100109_2,GenesisBrowser (HTTP 1.1; 0.9; XP SP2; .NET CLR 2.0.50727),Lunascape Genesis browser,B,,http://www.lunascape.tv/,
id_g_m_231205_1,genieBot (http://64.5.245.11/faq/faq.html),GenieKnows.com search,R, s. also: - larbin_2.6.3 (wgao@genieknows.com),http://www.genieknows.com/,
id_g_m_391,geniebot wgao@genieknows.com,GenieKnows.com search,R, s. also: - larbin_2.6.3 (wgao@genieknows.com),http://www.genieknows.com/,
id_g_m_050606_3,GeoBot/1.0,Unknown robot from wavepath.com (65.254.33.1xx),,no active website,,
id_g_m_392,GeonaBot 1.x; http://www.geona.com/,Geona Search robot / link checking,R,,http://www.geona.com,
id_g_m_160206_3,geourl/2.0b2,GeoURL ICBM Address Server - a location-to-URL reverse directory,C,,http://geourl.org/,
id_g_m_160206_2,GeoURLBot 1.0 (http://geourl.org),GeoURL ICBM Address Server - a location-to-URL reverse directory,C,,http://geourl.org/,
id_g_m_393,GetBot,Getbot web downloading tool / site grabber,D,,http://www.getbot.com,
id_g_m_394,GetRight/3.x.x,GetRight download manager,D,,http://www.getright.com,
id_g_m_395,GetRight/4.5xx,GetRight download manager,D,,http://www.getright.com,
id_g_m_396,GetRight/4.x,GetRight download manager,D,,http://www.getright.com,
id_g_m_397,GetRight/4.x[a-e],GetRight download manager,D,,http://www.getright.com,
id_g_m_260807_1,GetRight/6.1 (Pro),GetRight download manager,D,,http://www.getright.com,
id_g_m_398,GetRightPro/6.0beta2,GetRight download manager,D,,http://www.getright.com,
id_g_m_170706_3,GetWeb/0.1 libwww-perl/5.16,GetWeb - web page to email service,D,216.204.133.xxx,http://www.healthnet.org/getweb.php,
id_g_m_399,GhostRouteHunter/20021130 (https://www.sixxs.net/tools/grh/; info@sixxs.net),Sixxs Ghost Route Hunter,C,,http://www.sixxs.net/tools/grh/,
id_g_m_400,gigabaz/3.1x (baz@gigabaz.com; http://gigabaz.com/gigabaz/),GigaBaz Brainbot (Germany) robot,R, s. also - MicroBaz,http://gigabaz.com,
id_g_m_401,Gigabot/2.0 (gigablast.com),Gigablast robot (64.62.168.xx),R,,http://www.gigablast.com,
id_g_m_140106_1,Gigabot/2.0/gigablast.com/spider.html,Gigablast robot,R,comes from 64.62.168.xx AND 66.154.102.xx,http://www.gigablast.com,
id_g_m_170506_1,Gigabot/2.0; http://www.gigablast.com/spider.html,Gigablast robot,R,comes from 64.62.168.xx AND 66.154.102.xx,http://www.gigablast.com,
id_g_m_190507_1,Gigabot/2.0att,Gigablast robot,R,66.231.188.1xx,http://www.gigablast.com,
id_g_m_230508_1,Gigabot/3.0 (http://www.gigablast.com/spider.html),Gigablast robot,R,66.231.18x.[x]xx,http://www.gigablast.com,
id_g_m_402,Gigabot/x.0,Gigablast robot (64.62.168.xx),R,,http://www.gigablast.com,
id_g_m_403,GigabotSiteSearch/2.0 (sitesearch.gigablast.com),Gigablast robot (64.62.168.xx),R,,http://www.gigablast.com,
id_g_m_404,GNODSPIDER (www.gnod.net),www.gnod.net spider,R,,http://www.gnod.net,
id_g_m_406,Go!Zilla 3.x (www.gozilla.com),Go!Zilla download manager,D,,http://www.gozilla.com,
id_g_m_407,Go!Zilla/4.x.x.xx,Go!Zilla download manager,D,,http://www.gozilla.com,
id_g_m_405,Go-Ahead-Got-It/1.1,GotIt web accelerator (discontinued),P D,,,
id_g_m_408,Goblin/0.9 (http://www.goguides.org/),GoGuides.Org (195.226.137.xx) robot,R,,http://www.goguides.org/goblin-info.html,
id_g_m_409,Goblin/0.9.x (http://www.goguides.org/goblin-info.html),GoGuides.Org (195.226.137.xx) robot,R,,http://www.goguides.org/goblin-info.html,
id_g_m_410,GoForIt.com,GoForIt Search robot,R,208.109.236.xx,http://www.goforit.com,
id_g_m_411,GOFORITBOT ( http://www.goforit.com/about/ ),GoForIt Search robot,R,208.109.236.xx,http://www.goforit.com,
id_g_m_020306_1,GoGuides.Org Link Check,GoGuides.org directory & search link checking,C,,http://www.goguides.org/,
id_g_m_230207_2,GoldenFeed Spider 1.0 (http://www.goldenfeed.com),GoldenFeed.com - RSS search engine,C,74.52.41.1xx,http://www.goldenfeed.com/,
id_g_m_412,Goldfire Server,Invention Machines Goldfire Server,P,,http://www.invention-machine.com/custsupport/GFR_install.cfm,
id_g_m_041006_1,gonzo1[P] +http://www.suchen.de/popups/faq.jsp,suchen.de German local search robot,R,212.34.185.xx,http://www.suchen.de/,
id_g_m_130108_2,gonzo2[P] +http://www.suchen.de/faq.html,suchen.de German local search robot,R,212.34.185.xx,http://www.suchen.de/,
id_g_m_413,Goofer/0.2,Some private robot (Wanadoo.fr client),R,,,
id_g_m_300606_1,Google Talk,Google instant messenger,B,,http://www.google.com/talk/,
id_g_m_414,googlebot (larbin2.6.0@unspecified.mail),Packard Bell Net user robot (*not* Google),,,,
id_g_m_050106_1,Googlebot-Image/1.0,Google image crawler (66.249.72.xxx),R,,http://www.google.com,
id_g_m_415,Googlebot-Image/1.0 ( http://www.googlebot.com/bot.html),Google image crawler (66.249.72.xxx),R,,http://www.google.com,
id_g_m_416,Googlebot/2.1 ( http://www.google.com/bot.html),Google robot 66.249.64.XXX,R, s. also: - Mozilla/4.0 (MobilePhone SCP ... - Mozilla/5.0 (compatible; Googlebot/2.1...,http://www.google.com,
id_g_m_417,Googlebot/2.1 ( http://www.googlebot.com/bot.html),Google robot 66.249.64.XXX,R,,http://www.google.com,
id_g_m_418,Googlebot/Test ( http://www.googlebot.com/bot.html),Google robot 66.249.64.XXX,R,,http://www.google.com,
id_new_280209_2,Gordon's Spider/Nutch-0.9 (http://www.sharethis.com; gordon@sharethis.com),ShareThis social networking service via Amazon Web Services,C,174.129.242.x,http://sharethis.com/,http://www.amazonaws.com/
id_g_m_419,GrapeFX/0.3 libwww/5.4.0,Grapeshot web search system API,R,,http://www.grapeshot.co.uk/html/Index.html,
id_g_m_300907_4,great-plains-web-spider/flatlandbot (Flatland Industries Web Spider; http://www.flatlandindustries.com/flatlandbot.php; jason@flatlandindustries.com),Flatland Industries vertical search solution,R,74.62.161.xx,http://www.flatlandindustries.com/,http://www.flatlandindustries.com/flatlandbot.php
id_g_m_250707_2,GreatNews/1.0,GreatNews 1.0 Beta RSS reader,B,,http://www.curiostudio.com/,
id_g_m_170207_2,GreenBrowser,GreenBrowser - IE based browser (China),B,,http://www.morequick.com/indexen.htm,
id_g_m_100307_2,gridwell (http://search.gridwell.com),search gridwell favicon display,D,212.227.127.xx,http://search.gridwell.com/,
id_g_m_420,GrigorBot 0.8 (http://www.grigor.biz/bot.html),Grigor Search bot,R,,http://www.grigor.biz,
id_g_m_161206_1,Gromit/1.0,Australasian Legal Information Institute (AustLII) robot,R,,http://www.austlii.edu.au/,http://www2.austlii.edu.au/~dan/gromit/
id_g_m_421,grub crawler(http://www.grub.org),Grub open source crawler,R,,http://www.grub.org,
id_g_m_422,grub-client,Grub open source crawler,R,,http://www.grub.org,
id_g_m_423,gsa-crawler (Enterprise; GID-01422; jplastiras@google.com),Google Search Appliance robot (216.239.xx.xx),R,,http://www.google.com/enterprise/gsa/,
id_g_m_424,gsa-crawler (Enterprise; GID-01742;gsatesting@rediffmail.com),Google Search Appliance robot (216.239.xx.xx),R,,http://www.google.com/enterprise/gsa/,
id_g_m_060506_1,gsa-crawler (Enterprise; GIX-02057; dm@enhesa.com),Google Enterprise Search Appliance used by Enhesa (212.35.100.1xx),R,,http://www.enhesa.com/enhesa/en/default.asp,http://www.google.com/enterprise/gsa/
id_g_m_311205_1,gsa-crawler (Enterprise; GIX-03519; cknuetter@stubhub.com),Google Enterprise Search Appliance used by IBM (129.41.20.1xx),R,,http://www.google.com/enterprise/gsa/,
id_g_m_425,gsa-crawler (Enterprise; GIX-0xxxx; enterprise-training@google.com),Google Search Appliance robot (216.239.xx.xx),R,,http://www.google.com/enterprise/gsa/,
id_g_m_081006_1,GSiteCrawler/v1.xx rev. xxx (http://gsitecrawler.com/),GSiteCrawler - Google sitemap generator for Windows,C,,http://gsitecrawler.com/,
id_g_m_260207_1,Guestbook Auto Submitter,Guestbook spamming tool,S,,,
id_g_m_426,Gulliver/1.3,Northernlight robot,R,,http://www.northernlight.com,
id_g_m_427,Gulper Web Bot 0.2.4 (www.ecsl.cs.sunysb.edu/~maxim/cgi-bin/Link/GulperBot),Yuntis Collaborative Web Resource Categorization and Ranking Project robot,R,,http://www.ecsl.cs.sunysb.edu/yuntis/,
id_g_m_140907_1,Gungho/0.08004 (http://code.google.com/p/gungho-crawler/wiki/Index),Gungho - Extensible web crawler written in Perl by Google Code,R,,http://code.google.com/p/gungho-crawler/wiki/Index,
id_g_m_211106_1,GurujiBot/1.0 (+http://www.guruji.com/WebmasterFAQ.html),guruji : the Indian search engine robot,R,209.128.80.1xx / 72.20.109.xx,http://www.guruji.com/,
id_g_m_100508_2,GurujiImageBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html),guruji : the Indian search engine picture crawler,R,72.20.109.xx,http://www.guruji.com/,
id_g_m_291108_3,Haier-T10C/1.0 iPanel/2.0 WAP2.0 (compatible; UP.Browser/6.2.2.4; UPG1; UP/4.0; Embedded),Openwave Mobile Browser on Haier T10C mobile,B,,http://www.openwave.com,
id_g_m_171105_5,HappyFunBot/1.1,Happy Fun Search robot,R,,http://www.happyfunsearch.com/bot.html,
id_g_m_428,Harvest-NG/1.0.2,Harvest-NG web crawler used by search.yahoo.com,R,see also Exalead NG and NG/1.0,http://search.yahoo.com,
id_g_m_429,Haste/0.12 (HOME: http://haste.kytoon.com/),Haste - web mapping and monitoring system,R C,site is closed,http://haste.kytoon.com,
id_g_m_430,Hatena Antenna/0.4 (http://a.hatena.ne.jp/help#robot),Hatena::Antenna Japan robot,R,221.186.146.xx,http://a.hatena.ne.jp,
id_g_m_110606_2,Hatena Mobile Gateway/1.0,Hatena Japan proxy for handheld/mobile clients,P,221.186.146.xx,http://www.hatena.ne.jp/,
id_g_m_431,Hatena Pagetitle Agent/1.0,Hatena Japan robot,R,221.186.146.xx,http://www.hatena.ne.jp,
id_g_m_240207_1,Hatena RSS/0.3 (http://r.hatena.ne.jp),Hatena Japan RSS feed robot,R,221.186.146.xx,http://www.hatena.ne.jp,
id_g_m_110606_1,HatenaScreenshot/1.0 (checker),Hatena::Diary (Japan) web page screenshot robot,R D,221.186.146.xx,http://www.hatena.ne.jp/,
id_g_m_120108_1,hbtronix.spider.2 -- http://hbtronix.de/spider.php,hbtronix.spider - Domain name spider (Germany),R,89.110.157.*,http://hbtronix.de/spider.php,
id_g_m_432,HeinrichderMiragoRobot,Mirago Germany robot,R,,http://www.mirago.de/,
id_g_m_433,HeinrichderMiragoRobot (http://www.miragorobot.com/scripts/deinfo.asp),Mirago Germany robot,R,,http://www.mirago.de/,
id_g_m_434,Helix/1.x ( http://www.sitesearch.ca/helix/),Helix - The SiteSearch (Canada) web crawler,R,,http://www.sitesearch.ca,
id_g_m_080206_3,HenriLeRobotMirago (http://www.miragorobot.com/scripts/frinfo.asp),Mirago France robot,R,,http://www.mirago.fr/,
id_g_m_435,HenrytheMiragoRobot,Mirago search (UK) robot,R,217.154.245.2xx,http://www.mirago.co.uk,
id_g_m_060806_3,HenryTheMiragoRobot (http://www.miragorobot.com/scripts/mrinfo.asp),Mirago search (UK) robot,R,217.154.245.2xx,http://www.mirago.co.uk,
id_g_m_436,hgrepurl/1.0,O'Reilly's Perl LWP example client program from Web Client Programming with Perl,,,,
id_g_m_437,Hi! I'm CsCrawler my homepage: http://www.kde.cs.uni-kassel.de/lehre/ss2005/googlespam/crawler.html RPT-HTTPClient/0.3-3,University of Kassel Germany CsCrawler using the HTTPClient library,R,,http://www.kde.cs.uni-kassel.de/lehre/ss2005/googlespam/crawler.html,http://www.innovation.ch/java/HTTPClient/
id_g_m_438,HiDownload,HiDownload download manager,D,,http://www.streamingstar.com/hidownload.htm,
id_g_m_439,Hippias/0.9 Beta,Hippias robot,R,site is offline,http://hippias.evansville.edu,
id_g_m_440,HitList,Pilot Hitlist web analytics solution,R,,http://www.pilotsoftware.com/products_solutions/hitlist.html,
id_g_m_441,Hitwise Spider v1.0 http://www.hitwise.com,Hitwise spider,R,,http://www.hitwise.com,
id_g_m_442,HLoader,diff. IPs / unknown services,, i.e.: - 204.95.207.xxx user agent ? - 66.27.113.xx link checking ?,,
id_g_m_040907_1,holmes/3.11 (http://morfeo.centrum.cz/bot),Morfeo / Centrum Search (Czech Republic) robot from 65.102.46.xxx,R,,http://morfeo.centrum.cz/,
id_g_m_220906_2,holmes/3.9 (onet.pl),Onet.pl (Poland) search robot,R,213.180.137.xx,http://szukaj.onet.pl/,
id_g_m_181006_1,holmes/3.xx (OnetSzukaj/5.0; +http://szukaj.onet.pl),Onet.pl (Poland) search robot,R,213.180.137.xx,http://szukaj.onet.pl/,
id_g_m_443,holmes/x.x,Morfeo / Centrum Search (Czech Republic) robot from 65.102.46.xxx,R,,http://morfeo.centrum.cz/,
id_g_m_021108_2,HolmesBot (http://holmes.ge),Holes search robot (Georgia),R,77.92.229.3x,http://holmes.ge/,
id_g_m_444,HomePageSearch(hpsearch.uni-trier.de),HomePageSearch robot,R,,http://hpsearch.uni-trier.de/,
id_g_m_445,Homerbot: www.homerweb.com,Homerweb search robot,R,,http://www.homerweb.com,
id_g_m_220606_1,Honda-Search/0.7.2 (Nutch; http://lucene.apache.org/nutch/bot.html; search@honda-search.com),Honda-Search.com - Honda cars related search robot,R,69.16.227.1xx,http://www.honda-search.com/,
id_g_m_090206_1,HooWWWer/2.1.3 (debugging run) (+http://cosco.hiit.fi/search/hoowwwer/ | mailto:crawler-info<at>hiit.fi),HooWWer - Next Generation Information Retrieval robot ,R,,http://cosco.hiit.fi,
id_g_m_446,HooWWWer/2.1.x ( http://cosco.hiit.fi/search/hoowwwer/ | mailto:crawler-info<at>hiit.fi),HooWWer - Next Generation Information Retrieval robot (128.214.112.xx),R,,http://cosco.hiit.fi/,
id_g_m_447,HotJava/1.0.1/JRE1.1.x,HotJava browser plus HTML Component 1.1.x,B,,,
id_g_m_448,Hotzonu/x.0,Hotzuno - Japanese BBS reader client,B,,http://hotzonu.hp.infoseek.co.jp/,
id_g_m_040507_1,HPL/Nutch-0.9 -,Unknown robot from HP Labs,R,15.203.249.12x,http://hpl.hp.com/,
id_g_m_449,htdig/3.1.6 (http://computerorgs.com),COMPUTERorgs.com robot (205.134.190.xxx) using htdig,R,,http://www.computerorgs.com/,http://www.htdig.org
id_g_m_210106_1,htdig/3.1.6 (unconfigured@htdig.searchengine.maintainer),htdig used by the Academie de Toulouse,R,reads robots.txt,http://www.ac-toulouse.fr/html/_.php,http://www.htdig.org
id_g_m_450,htdig/3.1.x (root@localhost),htdig search tool,R,,http://www.htdig.org,
id_g_m_451,Html Link Validator (www.lithopssoft.com),Lithops Software link validation tool,C,,http://www.lithopssoft.com,
id_g_m_110506_3,HTML2JPG Blackbox, http://www.html2jpg.com,HTML2JPG webpage to image converter,D,,http://www.html2jpg.com,
id_g_m_452,HTML2JPG Enterprise,HTML2JPG webpage to image converter,D,,http://www.html2jpg.com,
id_g_m_101205_1,HTMLParser/1.x,HTML Parser Java library to parse HTML,D,,http://sourceforge.net/projects/htmlparser,
id_g_m_071006_1,HTTP Retriever,PHP HTTP client to access Web servers,D,,http://code.blitzaffe.com/pages/home/,
id_g_m_240306_1,http://Anonymouse.org/ (Unix),Anonymous web proxy service,P,,http://anonymouse.org/,
id_g_m_453,http://Ask.24x.Info/ (http://narres.it/),Ask 24x Info (Germany) DMOZ related robot,R,,http://narres.it,
id_g_m_070209_6,http://hilfe.acont.de/bot.html ACONTBOT,ACONTBOT - Acont search Germany robot,R,82.149.246.2x,http://acont.de/,http://hilfe.acont.de/bot.htm
id_g_m_230408_1,http://OzySoftware.com/Index.html,OzySoftware.com software directory link checking,C,202.173.141.x,http://ozysoftware.com/index.html,
id_g_m_454,http://www.almaden.ibm.com/cs/crawler,IBM's Almaden Research robot,R, s. also: - FocusedSampler - WFARC,http://www.almaden.ibm.com,
id_g_m_455,http://www.almaden.ibm.com/cs/crawler [rc1.wf.ibm.com],IBM's Almaden Research robot,R,,http://www.almaden.ibm.com,
id_g_m_456,http://www.almaden.ibm.com/cs/crawler [wf216],IBM's Almaden Research robot,R,,http://www.almaden.ibm.com,
id_g_m_271105_4,http://www.istarthere.com_spider@istarthere.com,Istarthere.com search robot,R,,http://www.istarthere.com/,
id_g_m_070106_1,http://www.monogol.de,Monogol - German open source search engine project (195.226.167.1xx),R,,http://www.monogol.de/,
id_g_m_060806_4,http://www.trendtech.dk/spider.asp),TrendTech Search Engine (Denmark) robot,R,87.104.18.xx,http://www.trendtech.dk/,
id_g_m_290106_1,HTTP::Lite/2.x.x,HTTP::Lite - Standalone Perl module for retreiving HTTP documents,D,,http://www.toybox.ca/http-lite/,
id_g_m_050108_1,HTTPEyes,HTTPEyes - Web proxy cache,P,,http://bachue.com/httpeyes/,
id_g_m_457,HTTPResume v. 1.x,HTTPResume Amiga download manager,D,,http://tesla.rcub.bg.ac.yu/%7Eantony/HTTPResume/,
id_g_m_031107_2,httpunit/1.5,HttpUnit - Java test code for emulating browser behaviour,B,,http://httpunit.sourceforge.net/,
id_g_m_090306_1,httpunit/1.x,HttpUnit - Java browser behavior simulation tool,B,,http://httpunit.sourceforge.net/,
id_g_m_010807_1,Hybrid/1.2 [en] (OS Independent),Hybrid Share mono C#/Gtk# application for file sharing,,,http://hybrid-share.sourceforge.net/index.php,
id_g_m_300507_1,HyperEstraier/1.x.xx,Hyper Estraier full-text search system,D,,http://hyperestraier.sourceforge.net/,
id_g_m_170906_1,i1searchbot/2.0 (i1search web crawler; http://www.i1search.com; crawler@i1search.com),i1search robot,R,65.111.164.1xx,http://www.i1search.com/,
id_g_m_461,IAArchiver-1.0,Alexa / The Internet Archive (209.237.238.1xx),R,,http://www.alexa.com,
id_g_m_091205_2,iaskspider,Unknown robot (reads robots.txt) from chinatelecom (219.142.78.xx),,Not from iask.com.cn - s. also Mozilla/5.0 (compatible; iaskspider/1.0 ..,,
id_g_m_111106_1,iaskspider2 (iask@staff.sina.com.cn),Iask search / Sina portal robot (China),R,202.106.184.xxx,http://iask.com/,http://english.sina.com/index.html
id_g_m_458,ia_archiver,Alexa / The Internet Archive (209.237.238.1xx),R,,http://www.alexa.com,
id_g_m_459,ia_archiver-web.archive.org,Alexa / The Internet Archive (209.237.238.1xx),R,,http://www.alexa.com,
id_g_m_460,ia_archiver/1.6,Alexa / The Internet Archive (209.237.238.1xx),R,,http://www.alexa.com,
id_g_m_462,IBrowse/2.2 (AmigaOS 3.5),IOSpirit iBrowse Amiga Browser,B,was Hisoft (http://www.hisoft.co.uk),http://amiga.iospirit.de/,
id_g_m_463,IBrowse/2.2 (Windows 3.1),IOSpirit iBrowse Amiga Browser,B,was Hisoft (http://www.hisoft.co.uk),http://amiga.iospirit.de/,
id_g_m_464,iCab/2.5.2 (Macintosh; I; PPC),iCab MAC Web browser,B,,http://www.icab.de,
id_g_m_110207_2,ICC-Crawler(Mozilla-compatible; http://kc.nict.go.jp/icc/crawl.html; icc-crawl(at)ml(dot)nict(dot)go(dot)jp),Knowledge Clustered Group ICC-Crawler (University of Tokyo - Japan),R,202.180.34.1xx,http://kc.nict.go.jp/icc/crawl.html,
id_g_m_250607_1,ICC-Crawler(Mozilla-compatible;http://kc.nict.go.jp/icc/crawl.html;icc-crawl-contact(at)ml(dot)nict(dot)go(dot)jp),Knowledge Clustered Group ICC-Crawler (University of Tokyo - Japan),R,202.180.34.1xx,http://kc.nict.go.jp/icc/crawl.html,
id_g_m_465,iCCrawler (http://www.iccenter.net),ICJobs - Intelligence Competence Center (Germany) robot,R,212.227.76.xx,http://www.iccenter.net,
id_g_m_121006_1,ICCrawler - ICjobs (http://www.icjobs.de/bot.htm),ICJobs - Intelligence Competence Center (Germany) robot,R,212.227.76.xx,http://www.iccenter.net,
id_g_m_466,ICE Browser/5.05 (Java 1.4.0; Windows 2000 5.0 x86),ICE Java browser,B,,http://www.ii.uib.no/~alexey/jb/,
id_g_m_040206_2,ichiro/x.0 (http://help.goo.ne.jp/door/crawler.html),Goo Japan / Inktomi robot (210.173.179.xx),R, s. also moget / mogimogi,http://www.goo.ne.jp,
id_g_m_468,ichiro/x.0 (ichiro@nttr.co.jp),Goo Japan / Inktomi robot (210.173.179.xx),R, s. also moget / mogimogi,http://www.goo.ne.jp,
id_g_m_469,IconSurf/2.0 favicon finder (see http://iconsurf.com/robot.html),Iconsurf.com - Visual Surf Engine / favicon finder,R,,http://iconsurf.com,
id_g_m_470,IconSurf/2.0 favicon monitor (see http://iconsurf.com/robot.html),Iconsurf.com - Visual Surf Engine / favicon finder,R,,http://iconsurf.com,
id_g_m_471,ICOO Loader v.x.x.x,icooLoader download manager,D,,http://www.icoonet.com,
id_g_m_472,ICRA_label_spider/x.0,ICRA (Internet Content Rating Association) label spider,R,,http://www.icra.org,
id_g_m_473,icsbot-0.1,ICS Robot Search Engine (International Christian school of Seoul),R,,http://icseoul.org/,
id_g_m_260306_1,IDA,Internet Download Accelerator,D,,http://www.westbyte.com/ida/,
id_g_m_474,ideare - SignSite/1.x,Janas (Ideare.com / Tiscali.it) robot,R,,,
id_g_m_200806_1,iearthworm/1.0, iearthworm@yahoo.com.cn,Unknown UA from Yahoo China,,202.165.105.x,,
id_g_m_475,IEFav172Free,Some bookmark manager,C, possibly Visit URL ??,http://www.lodz.pdi.net/%7Eeristic/free/index.html,
id_g_m_060608_4,iFeed.jp/2.0 (www.psychedelix.com/agents/agents.rss; 0 subscribers),iFeed.jp - online rss aggregator (in development),R,67.15.2[3-4][X].xxx,http://www.ifeed.jp/,
id_g_m_281207_1,igdeSpyder (compatible; igde.ru; +http://igde.ru/doc/tech.html),Igde search (Russia) robot,R,87.118.118.12x,http://igde.ru/,
id_g_m_476,iGetter/1.x (Macintosh;G;PPC),iGetter download manager,D,,http://www.igetter.net,
id_g_m_477,iGetter/2 (Macintosh; U; PPC Mac OS X; en),iGetter download manager,D,,http://www.igetter.net,
id_g_m_120507_1,IIITBOT/1.1 (Indian Language Web Search Engine; http://webkhoj.iiit.net; pvvpr at iiit dot ac dot in),Webkhoj - Indian language search engine,R,196.12.53.xx,http://webkhoj.iiit.net/,
id_g_m_040607_2,ilial/Nutch-0.9 (Ilial, Inc. is a Los Angeles based Internet startup company. For more information please visit http://www.ilial.com/crawler; http://www.ilial.com/crawler; crawl@ilial.com),Ilial Knowledge Search robot,R,72.44.58.2xx,http://www.ilial.com/crawler/,
id_g_m_290906_1,ilial/Nutch-0.9-dev,Unknown robot from UCLA using Nutch,R,164.67.195.xx,http://www.ucla.edu/,http://lucene.apache.org/nutch/
id_g_m_270806_1,IlseBot/1.x,Ilse Netherlands robot (62.69.178.xx),R,s. also INGRID/3.0 .. / Mozilla/3.0 (INGRID/3.0 ..,http://www.ilse.nl/,
id_g_m_478,IlTrovatore-Setaccio ( http://www.iltrovatore.it),Il Trovatore - Italian search engine robot,R,213.215.201.2xx,http://www.iltrovatore.it,
id_g_m_479,Iltrovatore-Setaccio/0.3-dev (Indexing; http://www.iltrovatore.it/bot.html; info@iltrovatore.it),Il Trovatore - Italian search engine robot,R,213.215.201.2xx,http://www.iltrovatore.it,
id_g_m_480,IlTrovatore-Setaccio/1.2 ( http://www.iltrovatore.it/aiuto/faq.html),Il Trovatore - Italian search engine robot,R,213.215.201.2xx,http://www.iltrovatore.it,
id_g_m_481,Iltrovatore-Setaccio/1.2 (It-bot; http://www.iltrovatore.it/bot.html; info@iltrovatore.it),Il Trovatore - Italian search engine robot,R,213.215.201.2xx,http://www.iltrovatore.it,
id_g_m_482,iltrovatore-setaccio/1.2-dev (spidering; http://www.iltrovatore.it/aiuto/.....),Il Trovatore - Italian search engine robot,R,213.215.201.2xx,http://www.iltrovatore.it,
id_g_m_040506_1,IlTrovatore/1.2 (IlTrovatore; http://www.iltrovatore.it/bot.html; bot@iltrovatore.it),Il Trovatore - Italian search engine robot,R,213.215.201.2xx,http://www.iltrovatore.it,
id_g_m_060107_2,ImageVisu/v4.x.x,ImageVisu image and graphics viewer - display files from the Web (HTTP and ECWP),B,,http://geovisu.free.fr/imagvisu/english/,
id_g_m_080907_1,ImageWalker/2.0 (www.bdbrandprotect.com),BD-Brandprotect copyright infringement crawler,R,72.14.164.1xx,http://www.bdbrandprotect.com/,http://www.bdbrandprotect.com/solutions_5.html
id_g_m_110306_1,Incutio HttpClient v0.x,HttpClient - a PHP Web Client Class,,,http://scripts.incutio.com/httpclient/index.php,
id_g_m_483,IncyWincy data gatherer(webmaster@loopimprovements.com,IncyWincy search engine using DMOZ Open Directory database,R,,http://www.loopimprovements.com,
id_g_m_484,IncyWincy page crawler(webmaster@loopimprovements.com,IncyWincy search engine using DMOZ Open Directory database,R,,http://www.loopimprovements.com,
id_g_m_485,IncyWincy(http://www.look.com),Look.com robot using IncyWincy search engine,R,,http://www.loopimprovements.com,
id_g_m_486,IncyWincy(http://www.loopimprovements.com/robot.html),IncyWincy search engine using DMOZ Open Directory database,R,,http://www.loopimprovements.com,
id_g_m_487,IncyWincy/2.1(loopimprovements.com/robot.html),IncyWincy search engine using DMOZ Open Directory database,R,,http://www.loopimprovements.com,
id_g_m_488,IndexTheWeb.com Crawler7,Index the Web (69.57.134.xx) crawler,R,,http://www.indextheweb.com/,
id_g_m_489,Industry Program 1.0.x,Spam bot from diff. IPs,S,see also Educate Search VxB - Full Web Bot,,
id_g_m_490,Inet library,Inet Library Resource Center robot,R,,http://www.inetlibrary.com,
id_g_m_491,InetURL/1.0,InetURL IVM (phone software) plugin for web server access ?,,,http://www.nch.com.au/ivm/plugins.html,
id_g_m_270607_1,info@pubblisito.com- (http://www.pubblisito.com) il Sud dei Motori di Ricerca,Pubblisito.com search - Italia,R,88.149.164.2xx,http://www.pubblisito.com/search/,
id_g_m_211208_2,Infoaxe./Nutch-0.9,Infoaxe - search history and bookmark service,C,75.126.48.17x,http://www.infoaxe.com/,
id_g_m_492,infoConveraCrawler/0.8 ( http://www.authoritativeweb.com/crawl),Converas RetrievalWare Internet Spider (63.241.61.x),R S ?,s.also - Convera... Maybe does guestbook / forum spamming s. here http://www.webmasterworld.com/forum11/2871.htm,http://www.convera.com/Products/,
id_g_m_493,InfoFly/1.0 (http://www.versions-project.org/),Versions-project.org Ingelin spider,R,,http://www.versions-project.org/,
id_g_m_494,InfoLink/1.x,InfoLink link checking tool,C,,http://www.biggbyte.com/biggbyte3/index.html,
id_g_m_495,INFOMINE/8.0 Adders,INFOMINE Scholary Internet Resource Collection crawler,R,,http://infomine.ucr.edu,
id_g_m_496,INFOMINE/8.0 RemoteServices,INFOMINE Scholary Internet Resource Collection crawler,R,,http://infomine.ucr.edu,
id_g_m_497,INFOMINE/8.0 VLCrawler (http://infomine.ucr.edu/useragents),INFOMINE Scholary Internet Resource Collection crawler,R,,http://infomine.ucr.edu,
id_g_m_498,InfoNaviRobot(F107),164.71.1.1xx jp.co.fujitsu.t2 Robot,R,,,
id_g_m_499,InfoSeek Sidewinder/0.9,Infoseek robot,R,,http://www.infoseek.com,
id_g_m_500,InfoSeek Sidewinder/1.0A,Infoseek robot,R,,http://www.infoseek.com,
id_g_m_501,InfoSeek Sidewinder/1.1A,Infoseek robot,R,,http://www.infoseek.com,
id_g_m_502,Infoseek SideWinder/1.45 (Compatible; MSIE 10.0; UNIX),Infoseek robot,R,,http://www.infoseek.com,
id_g_m_503,Infoseek SideWinder/2.0B (Linux 2.4 i686),Infoseek Japan robot,R,210.148.160.1xx,http://www.infoseek.com,
id_g_m_504,INGRID/3.0 MT (webcrawler@NOSPAMexperimental.net; http://webmaster.ilse.nl/jsp/webmaster.jsp),Ilse Netherlands robot (62.69.178.xx),R, s.also - Mozilla/3.0 (INGRID/3.0 .. / IlseBot/1.0 ..,http://www.ilse.nl/,
id_g_m_505,Inktomi Search,Inktomi (Hotbot-Lycos NBCi etc.) robot,R,,http://www.inktomi.com/,
id_g_m_506,InnerpriseBot/1.0 (http://www.innerprise.com/),Enterprise Search engine software (64.202.165.xxx) ,R,s. also - Enterprise_Search - ES.NET_Crawler,http://www.innerprise.net,
id_g_m_111205_4,Insitor.com search and find world wide!,Insitor Search robot (80.67.20.1xx),R,s. also Insitornaut,http://www.insitor.com/,
id_g_m_121205_3,Insitornaut,Insitor Search robot (80.67.20.1xx),R,s. also Insitor.com,http://www.insitor.com/,
id_g_m_507,InstallShield DigitalWizard,download manager,D,,,
id_g_m_200308_1,integrity/1.6,Integrity - website broken link checker for MAC OSx,C,,http://peacockmedia.co.uk/index.php/products/7-products/4-integrity,
id_g_m_010907_1,Intelix/0.x (cs; http://www.microton.cz/intelix/; microton@@microton.cz),Microton Intelix robot for Eurotran translation software ?,D,,http://www.microton.cz/intelix/,
id_g_m_508,Interarchy/x.x.x (InterarchyCrawler),Interarchy file transfer software - SFTP/FTP client for Mac OS X,D,,http://www.interarchy.com,
id_g_m_509,Internet Ninja x.0,Dream Train (Japan) Internet search robot,R,,http://www.dti.ne.jp,
id_g_m_510,InternetArchive/0.8-dev(Nutch;http://lucene.apache.org/nutch/bot.html;nutch-agent@lucene.apache,Heritrix - The Internet Archive's open-source crawler based on Nutch (207.241.225.2xx),R,s.also - archive.org_bot - Mozilla/5.0 (compatible;archive.org_bot/...,http://www.archive.org/,http://lucene.apache.org
id_g_m_511,InternetLinkAgent/3.1,Internet Link Agent - link checking tool,C,,http://www.osk.3web.ne.jp/~goronyan/winprg/sub.shtml,
id_g_m_512,InternetSeer.com,Internetseer Web site monitoring / Claymont robot,R,,http://www.internetseer.com,
id_g_m_513,intraVnews/1.x,intraVNews - Feed reader & RSS aggregator for Outlook,B,,http://www.intravnews.com,
id_g_m_061208_1,IOI/2.0 (ISC Open Index crawler; http://index.isc.org/; bot@index.isc.org),Internet Open Index crawler using Nutch,R,149.20.54.1xx,http://index.isc.org/,http://www.nutch.org
id_g_m_514,IP*Works! V5 HTTP/S Component - by /n software - www.nsoftware.com,IP*Works! HTTP Component,,,http://www.nsoftware.com/products/controls/?ctl=HTTP,
id_g_m_515,IP2LocationBot/1.0 <a href="http://www.ip2location.com">http://www.ip2location.com</a>,IP2Location - Reverse lookup geographical data and ISP by IP,R C,,http://www.ip2location.com,
id_g_m_270106_1,IP2MapBot/1.1 <a href=http://www.ip2map.com>http://www.ip2map.com</a>,IP2Map - geographical IP mapping,R C,,http://www.ip2map.com/,
id_g_m_516,IPiumBot laurion(dot)com,Laurions Ipium robot,R,,http://www.laurion.com,
id_g_m_517,IpselonBot/0.xx-beta (Ipselon; http://www.ipselon.com; ipselonbot@ipselon.com),Ipselon Web Search robot,R,,http://www.ipselon.com,
id_g_m_518,Iria/1.xxa,Iria download manager,D,,http://www5.tok2.com/home/koteturamu/soft/iria.htm,
id_g_m_519,IRLbot/1.0 ( http://irl.cs.tamu.edu/crawler),IRL-crawler - Texas A&M University research project crawler,R,128.194.135.xx,http://irl.cs.tamu.edu,
id_g_m_240308_4,IRLbot/3.0 (compatible; MSIE 6.0; http://irl.cs.tamu.edu/crawler/),IRL-crawler - Texas A&M University research project crawler,R,128.194.135.xx,http://irl.cs.tamu.edu,
id_g_m_520,IrssiUrlLog/0.2,url_log - Irssi Perl url grabber,,,http://www.irssi.org/scripts/html/url_log.pl.html,
id_g_m_521,Irvine/1.x.x,Irvine downloading tool,D,,http://hp.vector.co.jp/authors/VA024591/,
id_g_m_140506_1,ISC Systems iRc Search 2.1,Unknown spambot / harvester from diff. IPs,S,,http://www.projecthoneypot.org/ip_inspector.php?iph=978231e229521680d11cb93f32de0fa1,
id_g_m_030106_1,iSiloX/4.xx Windows/32,iSiloX document converter for iSilo reader,B,,http://www.isilox.com/,
id_g_m_522,isurf (tszhu@canada.com),Unknown University of Alberta link-checking ?,C,,http://www.ualberta.ca,
id_g_m_150408_5,iTunes/x.x.x,iTunes UA name for access and decrypt the iTunes music store pages,B,,http://www.apple.com/itunes/,
id_g_m_523,IUPUI Research Bot v 1.9a,Some spam bot from 66.139.78.xx(x),S,,,
id_g_m_280906_1,iVia Page Fetcher (http://ivia.ucr.edu/useragents.shtml),iVia robot - Open source Internet portal & virtual library system software,D,,http://ivia.ucr.edu/,
id_g_m_524,iVia/4.0 CanonizeUrl (http://infomine.ucr.edu/iVia/useragents.shtml,iVia robot - Open source Internet portal & virtual library system software,D,,http://ivia.ucr.edu/,
id_g_m_180707_1,IWAgent/ 1.0 - www.brandprotect.com,BD BrandProtect - brand, company or trademarks online monitoring,R,72.14.164.1xx,http://www.brandprotect.com/,
id_g_m_525,J-PHONE/3.0/J-SH07,Proxy message from jp-q.ne.jp,P,,,
id_g_m_526,Jabot/6.x (http://odin.ingrid.org/),ODIN Directory Japan robot (163.138.95.xx),R,,http://www.ingrid.org,
id_g_m_527,Jabot/7.x.x (http://odin.ingrid.org/),ODIN Directory Japan robot (163.138.95.xx),R,,http://www.ingrid.org,
id_g_m_528,Jack,German Domanova (offline since Feb.02) robot,R,,,
id_g_m_529,Jakarta Commons-HttpClient/2.0xxx,Jakarta Commons (Java based) HTTP client,B,,http://jakarta.apache.org/commons/httpclient/,
id_g_m_530,Jakarta Commons-HttpClient/3.0-rcx,Jakarta Commons (Java based) HTTP client,B,,http://jakarta.apache.org/commons/httpclient/,
id_g_m_240306_3,Jambot/0.1.x (Jambot; http://www.jambot.com/blog; crawler@jambot.com),JamBot search robot (70.146.82.xx),R,,http://www.jambot.com/,
id_g_m_130108_1,Jambot/0.2.1 (Jambot; http://www.jambot.com/blog/static.php?page=webmaster-robot; crawler@jambot.com),JamBot search robot,R,70.146.82.xx,http://www.jambot.com/,
id_g_m_531,Java 1.1,Java VM,,,http://java.sun.com/,
id_g_m_532,Java/1.4.1_01,Java VM,R B D, used as robot from 194.203.40.xx,http://java.sun.com/,
id_g_m_533,Java1.0.21.0,Java VM,B,,http://java.sun.com/,
id_g_m_534,Java1.1.xx.x,Java VM,,,http://java.sun.com/,
id_g_m_535,Java1.3.0rc1,Java VM,,,http://java.sun.com/,
id_g_m_536,Java1.3.x,Java VM,,,http://java.sun.com/,
id_g_m_537,Java1.4.0,Java VM,R B D,used by diff. IPs for various purposes i.e.: - Dortmund University Java based robot - Roadrunner.net (66.108.xxx.xxx) user robot in conjunction w. RPT-HTTPClient/0.3-3,http://java.sun.com/,http://www.informatik.uni-dortmund.DE
id_g_m_538,Jayde Crawler. http://www.jayde.com,Jayde B2B Search robot (66.28.139.xx),R,,http://www.jayde.com,
id_g_m_539,JBH Agent 2.0,some site downloading tool ? via 61.77.51.xxx,D,,,
id_g_m_540,jBrowser/J2ME Profile/MIDP-1.0 Configuration/CLDC-1.0 (Google WAP Proxy/1.0),WAP 2.0 / jBrowser for handhelds,B,,http://www.jataayusoft.com/DbWAPHH.htm,
id_g_m_541,JCheckLinks/0.1 RPT-HTTPClient/0.3-1,JCheckLinks Java hyperlink validator,C,,http://web.purplefrog.com/%7Ethoth/jchecklinks/,
id_g_m_542,JDK/1.1,Java Development Kit,,,http://developers.sun.com/index.html,
id_g_m_543,Jeode/1.x.x,Insignias Jeode (PDA) Java platform,B,,http://www.insignia.com/content/products/jvmProducts.shtml,
id_g_m_544,Jetbot/1.0,JetEye Search robot (64.62.142.xxx / 64.71.144.xxx),R,,http://www.jeteye.com,
id_g_m_545,JetBrains Omea Reader 1.0.x (http://www.jetbrains.com/omea_reader/),Omea RSS -  Atom - newsgroups web page reader ,B,,http://www.jetbrains.com/omea_reader/,
id_g_m_546,JetBrains Omea Reader 2.0 Release Candidate 1 (http://www.jetbrains.com/omea_reader/),Omea RSS -  Atom - newsgroups web page reader ,B,,http://www.jetbrains.com/omea_reader/,
id_g_m_547,JetCar,JetCar / Flashget download manager,D,,http://www.amazesoft.com,
id_g_m_548,Jigsaw/2.2.x W3C_CSS_Validator_JFouffa/2.0,Jigsaw - W3C's CSS Validator Server,C,,http://jigsaw.w3.org/css-validator/validator-uri.html,
id_g_m_550,JoBo/1.x (http://www.matuschek.net/jobo.html),Jobo website downloading program,D B,,http://www.matuschek.net/software/jobo/index.html,
id_g_m_549,JoBo/@JOBO_VERSION@(http://www.matuschek.net/jobo.html),Jobo website downloading program,D B,,http://www.matuschek.net/software/jobo/index.html,
id_g_m_551,JobSpider_BA/1.1,Finacialbot.com - German (213.61.218.xx) job search JobRoboter,R,,http://www.finbot.com/jr1.html,
id_g_m_552,JOC Web Spider,Jocsoft Web Spider - website downloading tool,D B,,http://www.jocsoft.com/jws/index.htm,
id_g_m_051206_5,JordoMedia/1.0 RSS File Reader (http://www.jordomedia.com),Jordo Media RSS / Atom feed directory link checking,C,216.227.208.1xx,http://www.jordomedia.com/,
id_g_m_090206_2,Journster [alpha] (http://journster.com/),Journster.com RSS/Atom aggregator,C,,http://beta.journster.com/,
id_g_m_090206_3,Journster.com RSS/Atom aggregator 0.5 (http://www.journster.com/bot.phtml),Journster.com RSS/Atom aggregator,C,,http://beta.journster.com/,
id_g_m_553,JRTS Check Favorites Utility,Check Favorites bookmark checking,C,,http://www.jrtwine.com/Products/CheckFavs/,
id_g_m_554,JRTwine Software Check Favorites Utility,Check Favorites bookmark checking,C,,http://www.jrtwine.com/Products/CheckFavs/,
id_g_m_555,Jyxobot/x,Jyxo search (Czech Republic) robot (212.71.128.xx),R,,http://jyxo.cz/,
id_g_m_556,K-Meleon/0.6 (Windows; U; Windows NT 5.1; en-US; rv:0.9.5) Gecko/20011011,K-meleon browser -  Windows 2000,B,,http://kmeleon.sourceforge.net/,
id_g_m_557,k2spider,Verity K2 Spider ( Network search software),R,,http://www.verity.com/products/pdf/MK0368a_K2_Spider.pdf,
id_g_m_010108_3,KAIST AITrc Crawler,Unknown robot from AITrc (Advanced Information Technology Research Center) - Korea,R,143.248.134.22x,http://aitrc.kaist.ac.kr/english/,
id_g_m_010506_1,KakleBot - www.kakle.com/0.1 (KakleBot - www.kakle.com; http:// www.kakle.com/bot.html; support@kakle.com),Kakle ranked metasearch robot,R,216.139.221.1xx,http://www.kakle.com/,
id_g_m_250408_3,kalooga/kalooga-4.0-dev-datahouse (Kalooga; http://www.kalooga.com; info@kalooga.com),Kalooga image crawler,R,195.210.57.1xx,http://www.kalooga.com/,
id_g_m_011108_3,kalooga/KaloogaBot (Kalooga; http://www.kalooga.com/info.html?page=crawler; crawler@kalooga.com),Kalooga image crawler,R,195.210.57.1xx,http://www.kalooga.com/,
id_g_m_558,Kapere (http://www.kapere.com),Kapere site grapper / web downloader,D,,http://www.kapere.com,
id_g_m_090807_1,Kazehakase/0.x.x.[x],Kazehakase - Gecko based browser (Japan),B,,http://kazehakase.sourceforge.jp/,
id_g_m_559,KDDI-SN22 UP.Browser/6.0.7 (GUI) MMP/1.1 (Google WAP Proxy/1.0),Openwave UP.Browser for mobiles via Google WAP Proxy (216.239.33.x),P,,http://www.openwave.com,
id_g_m_561,Kenjin Spider,Kenjin Spider search agent,R,,http://www.kenjin.ne.jp,
id_g_m_562,Kevin http://dznet.com/kevin/,Dznet.com Kevin crawler (link checking ?) via 68.39.148.xx (nj.comcast.net),R,,http://www.dznet.com,
id_g_m_563,Kevin http://websitealert.net/kevin/,Website AlertsKevin crawler (website monitoring) via 68.39.148.xx (nj.comcast.net),R,,http://www.websitealert.net,
id_g_m_560,KE_1.0/2.0 libwww/5.2.8,Voila.fr robot,R,,http://www.voila.fr,
id_g_m_301105_5,KFSW-Bot (Version: 1.01 powered by KFSW www.kfsw.de),Some Perl search script from KFSW (Germany),R,,http://www.kfsw.de/,
id_g_m_100206_4,kinja-imagebot (http://www.kinja.com/),kinja weblog search robot,R,,http://www.kinja.com/,
id_g_m_100206_3,kinjabot (http://www.kinja.com),kinja weblog search robot,R,,http://www.kinja.com/,
id_g_m_564,KIT-Fireball/2.0,Fireball search (Germany) robot,R,,http://www.fireball.de,
id_g_m_565,KIT-Fireball/2.0 (compatible; Mozilla 4.0; MSIE 5.5),Fireball search (Germany) robot,R,,http://www.fireball.de,
id_g_m_566,Klondike/1.50 (WSP Win32) (Google WAP Proxy/1.0),Klondike WAP Browser,B,,http://www.apachesoftware.com,
id_g_m_567,KnowItAll(knowitall@cs.washington.edu),University of Washington KnowItAll - web information extraction,R,,http://www.cs.washington.edu,
id_g_m_568,Knowledge.com/0.x,The knowledge.com (ODP) directory robot,R,,http://www.knowledge.com,
id_g_m_569,Kontiki Client x.xx,Kontiki Client download manager,D,,http://www.kontiki.com/client/userhelp_f.shtml,
id_g_m_280406_2,Krugle/Krugle,Nutch/0.8+ (Krugle web crawler; http://www.krugle.com/crawler/info.html; webcrawler@krugle.com),Krugle source code search engine for developers (64.71.164.1xx) ,R,powered by Nutch,http://www.krugle.com/,
id_g_m_180606_2,KSbot/1.0 (KnowledgeStorm crawler; http://www.knowledgestorm.com/resources/content/crawler/index.html; crawleradmin@knowledgestorm.com),KnowledgeStorm technology industry crawler for Findtech.com,R,12.129.110.xx,http://www.findtech.com/,http://www.knowledgestorm.com/resources/content/crawler/index.html
id_g_m_570,kuloko-bot/0.x,Kuloko contextual search robot,R,,http://www.kuloko.com/,
id_g_m_571,kulokobot www.kuloko.com kuloko@backweave.com,Kuloko contextual search robot,R,,http://www.kuloko.com,
id_g_m_572,kulturarw3/0.1,National Library of Sweden Heritage Project robot,R,,http://www.kb.se/ENG/kbstart.htm,
id_g_m_301105_2,KummHttp/1.1 (compatible; KummClient; Linux rulez),Link or server checking from Sanoma Budapest (195.70.35.xxx),C R,Sanoma also runs some web-portals i.e. http://www.startlap.com/,http://sanomabp.hu/,
id_new_280209_3,KWC-KX9/1109 UP.Browser/6.2.3.9.g.1.107 (GUI) MMP/2.0 UP.Link/6.3.0.0.0,UP.Browser for mobiles on Kyocera KWC-KX9 cellphone,B,,http://www.openwave.com,
id_g_m_211208_3,Labrador/0.2; http://ir.dcs.gla.ac.uk/labrador; craigm@dcs.gla.ac.uk,TREC Blog Track - Blog and news feed crawler,130.209.241.2xx,http://ir.dcs.gla.ac.uk/wiki/TREC-Blog,,
id_g_m_573,Lachesis,Intels Lachesis web site response time monitoring tool,C,,ftp://ftp.imag.fr/pub/labo-LSR/DRAKKAR/internet-performance/lachesis/,
id_g_m_140406_1,lanshanbot/1.0,Unknown robot from Easten Network China (202.96.51.1xx),,reads robots.txt,,
id_g_m_021206_2,lanshanbot/1.0 (+http://search.msn.com/msnbot.htm),Unknown robot from Easten Network China (202.96.51.1xx),,reads robots.txt,,
id_g_m_271105_1,LapozzBot/1.4 ( http://robot.lapozz.com),Lapozz search (Hungary) robot (82.131.195.xx),R,,http://www.lapozz.com/,
id_g_m_280508_3,LapozzBot/1.5 (+http://robot.lapozz.hu),Lapozz search (Hungary) robot (82.131.195.xx),R,,http://www.lapozz.com/,
id_g_m_574,larbin (samualt9@bigfoot.com),Larbin indexer used as Metacarta.com (66.28.xx.xxx) robot,R,,http://www.metacarta.com/,http://larbin.sourceforge.net/index-eng.html
id_g_m_592,LARBIN-EXPERIMENTAL (efp@gmx.net),Unknown robot from 66.230.140.xx (argon.oxeo.com),S,maybe an e-mail collector - see also Mozilla/4.0 efp@gmx.net,,
id_g_m_575,larbin_2.1.1 larbin2.1.1@somewhere.com,Larbin indexer used by Mitsubishi Electric Research Labs,R,,http://www.merl.com,http://larbin.sourceforge.net/index-eng.html
id_g_m_576,larbin_2.2.0 (crawl@compete.com),Larbin indexer used as Compete.com crawler,R,,http://www.compete.com,http://larbin.sourceforge.net/index-eng.html
id_g_m_577,larbin_2.2.1_de_Viennot (Laurent.Viennot@inria.fr),Larbin indexer used as Inria robot,R,,http://www.inria.fr/index.en.html,http://larbin.sourceforge.net/index-eng.html
id_g_m_578,larbin_2.2.2 (sugayama@lab7.kuis.kyoto-u.ac.jp),Larbin indexer used as Kyoto University robot,R,,http://www.kyoto-u.ac.jp/,http://larbin.sourceforge.net/index-eng.html
id_g_m_579,larbin_2.2.2_guillaume (guillaume@liafa.jussieu.fr),Larbin indexer used as Inria robot,R,,http://www.inria.fr/index.en.html,http://larbin.sourceforge.net/index-eng.html
id_g_m_581,larbin_2.6.0 (larbin2.6.0@unspecified.mail),Larbin indexer used by an unknown dsl.net client,R,,http://larbin.sourceforge.net/index-eng.html,
id_g_m_582,larbin_2.6.1 (larbin2.6.1@unspecified.mail),Larbin indexer used by diff. IPs / services,R, ie.: -Central Host Inc. (client) robot ? - Colt Net France robot,http://www.centralhost.com,http://larbin.sourceforge.net/index-eng.html
id_g_m_583,larbin_2.6.2 (hamasaki@grad.nii.ac.jp),Larbin indexer used by National Institut of Informatics (NII/Japan),R,,http://www.nii.ac.jp,http://larbin.sourceforge.net/index-eng.html
id_g_m_584,larbin_2.6.2 (larbin2.6.2@unspecified.mail),Larbin indexer used by diff. IPs,R,,http://larbin.sourceforge.net/index-eng.html,
id_g_m_585,larbin_2.6.2 (listonATccDOTgatechDOTedu),Larbin indexer used as robot by Georgia Institute of Technology http://www.gatech.edu/,R,,http://www.gatech.edu,http://larbin.sourceforge.net/index-eng.html
id_g_m_586,larbin_2.6.2 (pimenas@systems.tuc.gr),Larbin indexer used by Technical University of Crete,R,,http://www.systems.tuc.gr,http://larbin.sourceforge.net/index-eng.html
id_g_m_587,larbin_2.6.2 (tom@lemurconsulting.com),Larbin indexer used as Lemur Consulting robot,R,,http://www.lemurconsulting.com,http://larbin.sourceforge.net/index-eng.html
id_g_m_588,larbin_2.6.2 (vitalbox1@hotmail.com),Larbin indexer used as robot via cloud9.net (168.100.192.xxx),R,,http://larbin.sourceforge.net/index-eng.html,
id_g_m_261205_1,larbin_2.6.3 (ltaa_web_crawler@groupes.epfl.ch),Unknown robot from EPFL Lausanne Switzerland (128.178.155.1xx),R,reads robots.txt,http://www.epfl.ch/Eindex.html,
id_g_m_589,larbin_2.6.3 (wgao@genieknows.com),Larbin indexer used by GenieKnows.com search,R, s. also: - geniebot wgao@genieknows.com,http://www.genieknows.com,http://larbin.sourceforge.net/index-eng.html
id_g_m_590,larbin_2.6.3_for_(http://cosco.hiit.fi/search/) tsilande@hiit.fi,Larbin indexer used by Next Generation Information Retrieval (NGIR),R,,http://cosco.hiit.fi,http://larbin.sourceforge.net/index-eng.html
id_g_m_580,larbin_2.6_basileocaml (basile.starynkevitch@cea.fr),Larbin indexer used by CEA / DCom Rechercher,R,,http://www.cea.fr,http://larbin.sourceforge.net/index-eng.html
id_g_m_591,larbin_devel (http://pauillac.inria.fr/~ailleret/prog/larbin/),Larbin indexer used as Inria robot,R,,http://pauillac.inria.fr,http://larbin.sourceforge.net/index-eng.html
id_g_m_160807_2,lawinfo-crawler/Nutch-0.9-dev (Crawler for lawinfo.com pages; http://www.lawinfo.com; webmaster@lawinfo.com),LawInfo - Lawyer and attorney directory,R,216.86.137.xx,http://www.lawinfo.com/,
id_g_m_020506_3,lc/$ROADS::Version libwww-perl/5.00,ROADS - Perl web based subject based gateway tool,,,http://roads.opensource.ac.uk/,
id_g_m_593,lcabotAccept: */*,unknown robot via MTT.ca / Aliant.ca,,142.177.168.xxx,,
id_g_m_140408_1,LeapTag/0.8.1.beta081.r3750 (compatible; Mozilla 4.0; MSIE 5.5; robot@yoriwa.com),LeapTag news reader and content discovery tool,B,,http://www.leaptag.com/,
id_g_m_594,LECodeChecker/3.0 libgetdoc/1.0,Linkexchange crawler,R,,http://www.linkexchange.com,
id_g_m_595,LeechGet 200x (www.leechget.de),Leechget download manager,D,,http://www.leechget.de,
id_g_m_596,LEIA/2.90,Gseek.com (site is offline) robot,R,,,
id_g_m_597,LEIA/3.01pr (LEIAcrawler; [SNIP]),Gseek.com (site is offline) robot,R,,,
id_g_m_210106_2,LetsCrawl.com/1.0 +http://letscrawl.com/,Maybe logfile spamming for Lets crawl! search (Germany),S,website has no function,http://letscrawl.com/,
id_g_m_598,LexiBot/1.00,Lexibot (exMataHari) search software,R,,http://www.lexibot.com/index.asp,
id_g_m_140209_2,LG-LX260 POLARIS-LX260/2.0 MMP/2.0 Profile/MIDP-2.0 Configuration/CLDC-1.1,Polaris mobile browser on LG LX 260 Sprint Rumor phone,B,,http://www.infraware.co.kr/eng/01_product/product10.asp,
id_g_m_599,LG/U8138/v1.0,LG 8138 Mobile Phone browser,B,,,
id_g_m_600,Libby_1.1/libwww-perl/5.47,About.com robot,R,,http://www.about.com/,
id_g_m_100306_1,libcurl-agent/1.0,libcurl's (multiprotocol file transfer library) standard user-agent name,D,,http://curl.haxx.se/libcurl/,
id_g_m_080507_1,LibertyW (+http://www.lw01.com),LibertyW search for mobile (France),R,213.251.135.2xx,http://www.lw01.com/en/,
id_g_m_601,libWeb/clsHTTP -- hiongun@kt.co.kr,Korea Telecom Search robot,R,,http://www.kt.co.kr/kt_home/eng/index.jsp,
id_g_m_602,libwww-perl/5.41,CMP United Media robot,R,,http://www.cmpnet.com,
id_g_m_603,libwww-perl/5.45,SplatSearch robot (207.44.142.xx),R,,http://www.splatsearch.com,
id_g_m_604,libwww-perl/5.48,Alexa robot,R,,http://www.alexa.com,
id_g_m_605,libwww-perl/5.50,diff. IPs / services,R C P, ie.: - secure-netz.de link checking (in conjunction w. LWP::Simple/5.50) -N2H2 Internet filtering,http://www.n2h2.com,
id_g_m_606,libwww-perl/5.52 FP/2.1,Fast Search robot,R,,http://www.alltheweb.com,
id_g_m_607,libwww-perl/5.52 FP/4.0,Fast Search robot,R,,http://www.alltheweb.com,
id_g_m_608,libwww-perl/5.53,diff. IPs / services,R C P, ie.: -iPrism Web filtering software - softclub.net link checking,http://www.stbernard.com/default.asp,
id_g_m_609,libwww-perl/5.63,Profile for You internet profiling (?),R C,,http://www.profile4u.com,
id_g_m_610,libwww-perl/5.64,unknown link checking from Wanadoo.fr (193.253.33.xxx),R C,,,
id_g_m_611,libwww-perl/5.65,Amidalla search engine robot (62.241.33.xx),R, s. also amibot,http://www.amidalla.com,
id_g_m_612,libwww-perl/5.800,SplatSearch robot (72.36.210.xx),R,,http://www.splatsearch.com/,
id_g_m_613,libwww/5.3.2,Mediater Rechercher robot,R,,http://www.mediater.net,
id_g_m_160206_1,Liferea/0.x.x (Linux; en_US.UTF-8; http://liferea.sf.net/),Liferea - Linux feed reader,B,,http://li