|
|
|
|
|
XML Version |
 |
Home || Links || Banners || Feedback & Additions || E-Mail
|
|
|
|
List of User-Agents (Spiders, Robots, Crawler, Browser) [an error occurred while processing this directive]A - F:A searchable database of user-agents as used by browsers, search-engines spiders and crawlers, web-directories, download managers, link checkers, proxy servers, web filtering tools, harvesters, spambots, badbots. Sorted by the user-agents names with informations about their type, purpose and origin. The info-field at every user-agents entry offers even more information. Recent additions and updates are at the top of each page. The numerous Mozilla variations are not included in the alphabetical assortment "M" and can be found at an own page. Because of the many requests for a text only version of the database I decided to make a XML version available. You'll find a permanent link at the top left.
|
|
|||||
|
Legend: |
RECENT ADDITIONS AND UPDATES: |
Updated: 10/29/2014 22:38h |
|
String |
Description |
Type | Info |
|---|---|---|---|
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (FM Scene 4.6.1) | FM Scene soccer fan pages plugin | L | Info |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (.NET CLR 3.5.30729) (Prevx 3.0.5) | PrevX security plugin | Info |
|
String |
Description |
Type | Info |
|---|---|---|---|
| !Susie (http://www.sync2it.com/susie) | Sync2It bookmark management & clustering engine | C R | Info |
| <a href='http://www.unchaos.com/'> UnChaos </a> From Chaos To Order Hybrid Web Search Engine.(vadim_gonchar@unchaos.com) | UnCHAOS search robot | R | Info |
| <a href='http://www.unchaos.com/'> UnChaos Bot Hybrid Web Search Engine. </a> (vadim_gonchar@unchaos.com) | UnCHAOS search robot | R | Info |
| <b> UnChaosBot From Chaos To Order UnChaos Hybrid Web Search Engine at www.unchaos.com </b> (info@unchaos.com) | UnCHAOS search robot | R | Info |
| <http://www.sygol.com/> http://www.sygol.com | Sygol Search (Italy) robot | R | Info |
| ( Robots.txt Validator http://www.searchengineworld.com/cgi-bin/robotcheck.cgi ) | SearchEngineWorld's robots.txt validator | C | Info |
| (DreamPassport/3.0; isao/MyDiGiRabi) | DreamCast DreamPassport browser | B | Info |
| (Privoxy/1.0) | Privoxy web proxy | P | Info |
| */Nutch-0.9-dev | Unknown Yahoo robot | R | Info |
| +SitiDi.net/SitiDiBot/1.0 (+Have Good Day) | SitiDi.net search (Germany) robot | R | Info |
| -DIE-KRAEHE- META-SEARCH-ENGINE/1.1 http://www.die-kraehe.de | Die Kraehe Meta-Search-Engine (Germany) link checking | R | Info |
| 123spider-Bot (Version: 1.02, powered by www.123spider.de | 123spider.de (Germany) web directory link checking | C | Info |
| 192.comAgent | 192.com - UK web directory | R | Info |
| 1st ZipCommander (Net) - http://www.zipcommander.com/ | 1st ZipCommander Net - IE based browser | B | Info |
| 2Bone_LinkChecker/1.0 libwww-perl/5.64 | 2Bone online link checker | C | Info |
| 4anything.com LinkChecker v2.0 | 4Anything robot | R | Info |
| 8484 Boston Project v 1.0 | Unknown guestbook spamming or harvesting tool from diff. IPs | S | Info |
| :robot/1.0 (linux) ( admin e-mail: undefined http://www.neofonie.de/loesungen/search/robot.html ) | neofonie search robot Germany | R | Info |
| A-Online Search | A-Online.at robot - now Jet2Web Search | R | Info |
| A1 Keyword Research/1.0.2 (+http://www.micro-sys.dk/products/keyword-research/) miggibot/2007.03.27 | A1 Keyword Research - search engine and keyword optimization software | C | Info |
| A1 Sitemap Generator/1.0 (+http://www.micro-sys.dk/products/sitemap-generator/) miggibot/2006.01.24 | MiggiBot website crawler engine - A1 Sitemap Generator | R | Info |
| aardvark-crawler | Aardvark web crawler for Sun's Blog recommendations | R | Info |
| AbachoBOT | Abacho / Crawler.de robot | R | Info |
| AbachoBOT (Mozilla compatible) | Abacho / Crawler.de robot | R | Info |
| ABCdatos BotLink/5.xx.xxx#BBL | ABCdatos - Castilian program & tutorial directory | R | Info |
| Aberja Checkomat | Aberja Hybridsuchmaschine (Germany) link checking | R | Info |
| abot/0.1 (abot; http://www.abot.com; abot@abot.com) | Nameprotect copyright search robot (24.177.134.x) | R | Info |
| About/0.1libwww-perl/5.47 | About robot | R | Info |
| Accelatech RSSCrawler/0.4 | Accela Technology RSS feed crawler | R | Info |
| accoona | Accoona Search robot | R | Info |
| Accoona-AI-Agent/1.1.1 (crawler at accoona dot com) | Accoona Search robot | R | Info |
| Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com) | Accoona Search robot | R | Info |
| Ace Explorer | Ace Explorer - IE based browser | B | Info |
| Ack (http://www.ackerm.com/) | Ackerm search robot | R | Info |
| AcoiRobot | Acoi picture finder robot | R | Info |
| Acoon Robot v1.50.001 | Acoon.de search (Germany) robot | R | Info |
| Acoon Robot v1.52 (http://www.acoon.de) | Acoon.de search (Germany) robot | R | Info |
| Acoon-Robot 4.0.x.[xx] (http://www.acoon.de) | Acoon.de search (Germany) robot | R | Info |
| Acoon-Robot v3.xx (http://www.acoon.de and http://www.acoon.com) | Acoon.de search (Germany) robot | R | Info |
| Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at isara dot org) | Acorn Search Project | R | Info |
| ActiveBookmark 1.x | LibMaster.com Active Bookmark HTML page creator | C B | Info |
| Activeworlds | Activeworlds 3D homepage browser | B | Info |
| ActiveWorlds/3.xx (xxx) | Activeworlds 3D homepage browser | B | Info |
| Ad Muncher v4.xx.x | Ad Muncher - banner killer | P | Info |
| Ad Muncher v4x Build xxxxx | Ad Muncher - banner killer | P | Info |
| Adaxas Spider (http://www.adaxas.net/) | website directory adaxas link checking | C | Info |
| Advanced Browser (http://www.avantbrowser.com) | Avant Browser - IE based browser | B | Info |
| AESOP_com_SpiderMan | Aesop robot | R | Info |
| agadine/1.x.x (+http://www.agada.de) | Agada search (Germany) robot | R | Info |
| Agent-SharewarePlazaFileCheckBot/2.0+(+http://www.SharewarePlaza.com) | SharewarePlaza link checking | R | Info |
| AgentName/0.1 libwww-perl/5.48 | Linkomatic submission verifier | R | Info |
| AIBOT/2.1 By +(www.21seek.com A Real artificial intelligence search engine China) | 21seek.com (China) robot (218.17.90.xxx) | R | Info |
| AideRSS/1.0 (aiderss.com) | AideRss - Postrank RSS and Blog filtering | C | Info |
| aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com) | Nameprotect copyright search robot (24.177.134.x) | R | Info |
| aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com) | Nameprotect copyright search robot (24.177.134.x) | R | Info |
| Akregator/1.2.9; librss/remnants | Akregator news feed reader for KDE | B | Info |
| Aladin/3.324 | Aladin robot | R | Info |
| Alcatel-BG3/1.0 UP.Browser/5.0.3.1.2 | Phone.com UP.Browser for mobiles on Alcatel cellphone | B | Info |
| Aleksika Spider/1.0 (+http://www.aleksika.com/) | Aleksika Danmark - Search engine optimization spider | R | Info |
| AlertInfo 2.0 (Powered by Newsbrain) | Alertinfo - French version of Feedreader 3.xx | B | Info |
| AlkalineBOT/1.3 | Vestris robot | R | Info |
| AlkalineBOT/1.4 (1.4.0326.0 RTM) | Vestris robot | R | Info |
| Allesklar/0.1 libwww-perl/5.46 | Allesklar.de robot | R | Info |
| Alligator 1.31 (www.nearsoftware.com) | Alligator download manager | D | Info |
| Allrati/1.1 (+) | Unknown robot from Allrati.com | R | Info |
| AltaVista Intranet V2.0 AVS EVAL search@freeit.com | Altavista robot | R | Info |
| AltaVista Intranet V2.0 Compaq Altavista Eval sveand@altavista.net | Altavista robot | R | Info |
| AltaVista Intranet V2.0 evreka.com crawler@evreka.com | Altavista robot | R | Info |
| AltaVista V2.0B crawler@evreka.com | Altavista robot | R | Info |
| amaya/x.xx libwww/x.x.x | Amaya - W3C's Editor/Browser | B | Info |
| AmfibiBOT | Amfibi Search robot | R | Info |
| Amfibibot/0.06 (Amfibi Web Search; http://www.amfibi.com; agent@amfibi.com) | Amfibi Search robot | R | Info |
| Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com) | Amfibi Search robot | R | Info |
| amibot | amibot - Amidalla search engine robot (62.241.33.xx) | R | Info |
| Amiga-AWeb/3.4.167SE | AWeb Amiga browser | B | Info |
| AmigaVoyager/3.4.4 (MorphOS/PPC native) | Voyager - Amiga browser | B | Info |
| AmiTCP Miami (AmigaOS 2.04) | Amiga Miami TCP Stack | Info | |
| Amoi 8512/R21.0 NF-Browser/3.3 | NF embedded browser on Amois Skypephone | B | Info |
| amzn_assoc | Amazon.com robot for checking their affiliate sites | C | Info |
| AnnoMille spider 0.1 alpha - http://www.annomille.it | Annomille Italian historical oriented robot | R | Info |
| annotate_google; http://ponderer.org/download/annotate_google.user.js | annotate Google - Firefox extension for annotating Google search results | B | Info |
| Anonymized by ProxyOS: http://www.megaproxy.com | Megaproxy user | P | Info |
| Anonymizer/1.1 | faked user agent | Info | |
| AnswerBus (http://www.answerbus.com/) | AnswerBus natural language search using COLLATE technology | R | Info |
| AnswerChase PROve x.0 | AnswerChase search tool | Info | |
| AnswerChase x.0 | AnswerChase search tool | Info | |
| ANTFresco/x.xx | ANT Fresco Browser | B | Info |
| antibot-V1.1.5/i586-linux-2.2 | Antibot (discontinued) robot | R | Info |
| AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au;Engine) | Anzwers (Yahoo) Australia robot | R | Info |
| Apexoo Spider 1.x | Apexoo Search spider | R | Info |
| Aplix HTTP/1.0.1 | JavaOS app. for SEGA Saturn Internet and Sanyo Internet-TV | B | Info |
| Aplix_SANYO_browser/1.x (Japanese) | JavaOS app. for Sanyo Internet-TV | B | Info |
| Aplix_SEGASATURN_browser/1.x (Japanese) | JavaOS app. for SEGA Saturn Internet | B | Info |
| Aport | Aport robot | R | Info |
| appie 1.1 (www.walhello.com) | Walhello Internet Search robot | R | Info |
| Apple iPhone v1.1.4 CoreMedia v1.0.0.4A102 | CoreMedia player on Apple iPhone | B | Info |
| Apple-PubSub/65.1.1 | PubSub - Mac OS X utility for managing RSS/Atom subscriptions via the PubSub framework | B | Info |
| ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;) | Araby search - Arabia | R | Info |
| ArachBot | Covac Arachnid Web Crawler | R | Info |
| Arachnoidea (arachnoidea@euroseek.com) | Euroseek spider | R | Info |
| aranhabot | Amazon.com robot for checking their affiliate sites | C | Info |
| ArchitextSpider | Excite spider | R | Info |
| archive.org_bot | Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx) | R | Info |
| Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot com) | Simpy Bookmarklet crawler (69.55.233.xx) | C | Info |
| Arikus_Spider | Arikus inContext search engine software | R | Info |
| Arquivo-web-crawler (compatible; heritrix/1.12.1 +http://arquivo-web.fccn.pt) | Tomba project: the Portuguese web archive | R | Info |
| ASAHA Search Engine Turkey V.001 (http://www.asaha.com/) | Asaha search robot (Turkey) | R | Info |
| Asahina-Antenna/1.x | ASAHINA Antenna information detecting agent | R | Info |
| Asahina-Antenna/1.x (libhina.pl/x.x ; libtime.pl/x.x) | ASAHINA Antenna information detecting agent | R | Info |
| ask.24x.info | Ask 24x Info robot | R | Info |
| AskAboutOil/0.06-rcp (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@askaboutoil.com) | Ask About Oil - Petroleum related search (24.227.212.xxx) using Nutch | R | Info |
| asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot com) | askEd! / Inferret search (Japan) robot using Nutch | R | Info |
| ASPSeek/1.2.5 | ASPSeek search engine software -Yahoo-Inc. / Telecom Canada robot | R | Info |
| ASPseek/1.2.9d | Swsoft.net robot using Aspseek | R | Info |
| ASPSeek/1.2.x | ASPSeek search engine software | R | Info |
| ASPSeek/1.2.xa | ASPSeek search engine software | R | Info |
| ASPseek/1.2.xx | ASPSeek search engine software | R | Info |
| ASPSeek/1.2.xxpre | ASPSeek search engine software | R | Info |
| ASSORT/0.10 | Associative Sort robot | R | Info |
| asterias/2.0 | Singingfish media spider (64.12.186.2xx) via AOL search | R | Info |
| AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html) | Atlocal local business search robot | R | Info |
| Atomic_Email_Hunter/4.0 | Atomic Email Hunter email extracing and harvesting | S | Info |
| Atomz/1.0 | Atomz robot | R | Info |
| atSpider/1.0 | atSpider (ceased) email harvester / spambot | S | Info |
| Attentio/Nutch-0.9-dev (Attentio's beta blog crawler; www.attentio.com; info@attentio.com) | Attentio social media monitoring and analysing | R | Info |
| AU-MIC/2.0 MMP/2.0 | Samsung SPH-A660 phone with Sprint software | B | Info |
| AUDIOVOX-SMT5600 | Audiovox SMT5600 (AT&T) Smartphone mobile phone browser | B | Info |
| augurfind | Augurnet Swiss (was www.augurnet.ch) search robot | R | Info |
| augurnfind V-1.x | Augurnet Swiss (was www.augurnet.ch) search robot | R | Info |
| autoemailspider | Auto Email Pro Email harvester | S | Info |
| autohttp | Linkscan tool from Elsop | C | Info |
| autowebdir 1.1 (www.autowebdir.com) | Autowebdir - The Automatically Generated Web Directory | R | Info |
| AV Fetch 1.0 | Altavista robot ?? | R | Info |
| Avant Browser (http://www.avantbrowser.com) | Avant Browser - IE based browser | B | Info |
| AVSearch-1.0(peter.turney@nrc.ca) | National Research Council Canada robot | R | Info |
| AVSearch-2.0-fusionIdx-14-CompetitorWebSites | Unknown robot from 205.203.108.xx (telerate.com) | Info | |
| AVSearch-3.0(AltaVista/AVC) | Altavista robot | R | Info |
| AWeb | AWeb Amiga browser | B | Info |
| axadine/ (Axadine Crawler; http://www.axada.de/; ) | Axada search Germany robot | R | Info |
| AxmoRobot - Crawling your site for better indexing on www.axmo.com search engine. | Axmo search robot | R | Info |
| Azureus 2.x.x.x | Azureus Java BitTorrent Client | D | Info |
| BabalooSpider/1.3 (BabalooSpider; http://www.babaloo.si; spider@babaloo.si) | Babaloo search robot (Slovenia) | R | Info |
| BaboomBot/1.x.x (+http://www.baboom.us) | BaBoom Web Portal (ODP) robot (66.98.254.xx) | R | Info |
| BackStreet Browser 3.x | BackStreet Browser - Offline browser / website downloader | D | Info |
| BaiduImagespider+(+http://www.baidu.jp/search/s308.html) | Baidu search (Japan) image crawler | R | Info |
| BaiDuSpider | Baidu spidering engine - used by diff. IPs | R | Info |
| Baiduspider+(+http://help.baidu.jp/system/05.html) | Baidu spidering engine - used by diff. IPs | R | Info |
| Baiduspider+(+http://www.baidu.com/search/spider.htm) | Baidu spidering engine - used by diff. IPs | R | Info |
| Baiduspider+(+http://www.baidu.com/search/spider_jp.html) | Baidu search (Japan) crawler | R | Info |
| Balihoo/Nutch-1.0-dev (Crawler for Balihoo.com search engine - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com) | Balihoo - Vertical search engine crawler (beta) | R | Info |
| BanBots/1.2 (spider@banbots.com) | Project BanBots Perl script robot | C | Info |
| Barca/2.0.xxxx | Barca Pro email & PIM software | B | Info |
| BarcaPro/1.4.xxxx | Barca Pro email & PIM software | B | Info |
| BarraHomeCrawler (albertof@barrahome.org) | Barrahome crawler | R | Info |
| bCentral Billing Post-Process | Unknown user agent from Microsoft | Info | |
| bdcindexer_2.6.2 (research@bdc) | Business.com robot | R | Info |
| BDFetch | Brandimensions Brand Protection robot | R | Info |
| BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686) | Bdncentral Sitesearch robot | R | Info |
| BeamMachine/0.5 (dead link remover of www.beammachine.net) | beammachine web directory (Germany) link checking | R C | Info |
| beautybot/1.0 (+http://www.uchoose.de/crawler/beautybot/) | Beauty robot for Cosmoty - German beauty and wellness search | R | Info |
| BebopBot/2.5.1 ( crawler http://www.apassion4jazz.net/bebopbot.html ) | A Passion for Jazz music related search robot | R | Info |
| BeebwareDirectory/v0.01 | LinkcheckerBeepware (site is down) web directory link checking | C | Info |
| Big Brother (http://pauillac.inria.fr/~fpottier/) | Big Brother link checking tool | C | Info |
| Big Fish v1.0 | GoonGee.com link popularity checking | C | Info |
| BigBrother/1.6e | BB4 network monitoring | C | Info |
| BigCliqueBOT/1.03-dev (bigclicbot; http://www.bigclique.com; bot@bigclique.com) | BigClique Search robot | R | Info |
| BIGLOTRON (Beta 2;GNU/Linux) | Biglotron search (France) robot | R | Info |
| Bigsearch.ca/Nutch-x.x-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com) | Bigsearch.ca search robot | R | Info |
| Bilbo/2.3b-UNIX | Bilbo - web frontend for the Nessus Security Scanner | C | Info |
| BilgiBetaBot/0.8-dev (bilgi.com (Beta) ; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org) | Bilgi.com (Beta) search robot - Turkey | R | Info |
| BilgiBot/1.0(beta) (http://www.bilgi.com/; bilgi at bilgi dot com) | Bilgi.com (Beta) search robot - Turkey | R | Info |
| billbot wjj@cs.cmu.edu | Carnegie Mellon School robot/link checking ? | C | Info |
| Bitacle bot/1.1 | Bitacle Blog Search Archive robot | R | Info |
| Bitacle Robot (V:1.0;) (http://www.bitacle.com) | Bitacle Blog Search Archive robot | R | Info |
| Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx) | Biyubi Navigator - Mexican browser for Fenix OS | B | Info |
| BlackBerry7520/4.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/5.0.3.3 UP.Link/5.1.2.12 (Google WAP Proxy/1.0) | Blackberry Wireless Internet browser via Google WAP Proxy | B P | Info |
| BlackWidow | FS Consulting (was www.fsconsult.net) Black Widow web crawler | R | Info |
| BlackWidow | BlackWidow web site scanner / downloading tool | D | Info |
| Blaiz-Bee/1.0 (+http://www.blaiz.net) | Blaiz Enterprises RawGrunt search | R | Info |
| Blaiz-Bee/2.00.8222 (BE Internet Search Engine http://www.rawgrunt.com) | Blaiz Enterprises RawGrunt search | R | Info |
| Blaiz-Bee/2.00.xxxx (+http://www.blaiz.net) | Blaiz Enterprises RawGrunt search | R | Info |
| BlitzBOT@tricus.net | Blitzsuche Germany robot | R | Info |
| BlitzBOT@tricus.net (Mozilla compatible) | Blitzsuche Germany robot | R | Info |
| BlockNote.Net | BlockNote web page editor | B | Info |
| BlogBot/1.x | blogdex robot from MIT.edu | R | Info |
| BlogBridge 2.13 (http://www.blogbridge.com/) | BlogBridge RSS reader | B | Info |
| Bloglines Title Fetch/1.0 (http://www.bloglines.com) | Bloglines article search | R | Info |
| Bloglines-Images/0.1 (http://www.bloglines.com) | Bloglines graphics crawler | R | Info |
| Bloglines/3.1 (http://www.bloglines.com) | Bloglines news crawler | R | Info |
| BlogMap (http://www.feedmap.net) | FeedMap / BlogMap geo coding service | C | Info |
| Blogpulse (info@blogpulse.com) | Intelliseek's BlogPulse blog search | R | Info |
| BlogPulseLive (support@blogpulse.com) | Intelliseek's BlogPulse blog search | R | Info |
| BlogSearch/1.x +http://www.icerocket.com/ | IceRocket Web search robot | R | Info |
| blogsearchbot-pumpkin-3 | Art of Computing blog search project | R | Info |
| BlogsNowBot, V 2.01 (+http://www.blogsnow.com/) | BlogsNow realtime link tracker robot | R | Info |
| BlogVibeBot-v1.1 (spider@blogvibe.nl) | BlogVipe news and Blog crawler (Netherlands) | R | Info |
| blogWatcher_Spider/0.1 (http://www.lr.pi.titech.ac.jp/blogWatcher/) | blogWatcher robot from Okumura Group Tokyo (131.112.182.xxx) | R | Info |
| BlogzIce/1.0 (+http://icerocket.com; rhodes@icerocket.com) | IceRocket Web search robot | R | Info |
| BlogzIce/1.0 +http://www.icerocket.com/ | IceRocket Web search robot | R | Info |
| BloobyBot | Blooby search (beta) robot | R | Info |
| Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com) | Balihoo - Search Engine for Advertising Media | R | Info |
| bluefish 0.6 HTML editor | Bluefish HTML-editor for Linux | B | Info |
| BMCLIENT | Part of ButtMan remote access tool | Info | |
| BMLAUNCHER | Bookmark Express bookmark manager | C | Info |
| Bobby/4.0.x RPT-HTTPClient/0.3-3E | Bobby web accessibility desktop testing tool | C | Info |
| boitho.com-dc/0.xx (http://www.boitho.com/dcbot.html) | Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx | R | Info |
| boitho.com-robot/1.x | Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx | R | Info |
| boitho.com-robot/1.x (http://www.boitho.com/bot.html) | Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx | R | Info |
| Bookdog/x.x | Bookdog - Mac bookmark manager | C | Info |
| Bookmark Buddy bookmark checker (http://www.bookmarkbuddy.net/) | Bookmark Buddy - favorite bookmark manager | C | Info |
| Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] | Favourites managing program | C | Info |
| Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] (Version 2.0beta) | Favourites managing program | C | Info |
| BookmarkBase(2/;http://bookmarkbase.com) | Bookmark Base bookmark manager | C | Info |
| Bot mailto:craftbot@yahoo.com | cybercity.fr user robot / faked user agent ? | Info | |
| BPImageWalker/2.0 (www.bdbrandprotect.com) | BD-Brandprotect copyright infringement crawler | R | Info |
| BravoBrian bstop.bravobrian.it | BravoBrian bSTOP parental control | P R | Info |
| BravoBrian SpiderEngine MarcoPolo | Robot for BravoBrian bSTOP | R | Info |
| BrightCrawler (http://www.brightcloud.com/brightcrawler.asp) | BrightCloud web filtering for classifying websites | P R | Info |
| BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html) | Webarchive Project Bruinbot crawler | R | Info |
| BSDSeek/1.0 | Inktomi (Hotbot-Lycos NBCi) robot | R | Info |
| BStop.BravoBrian.it Agent Detector | BravoBrian bSTOP parental control | P R | Info |
| BTbot/0.x (+http://www.btbot.com/btbot.html) | BitTorrent Search Engine btbot robot | R | Info |
| BTWebClient/180B(9704) | µTorrent BitTorrent Client | D | Info |
| BuildCMS crawler (http://www.buildcms.com/crawler) | BuildCMS crawler - market monitoring project of BuildCMS | R | Info |
| Bulkfeeds/r1752 (http://bulkfeeds.net/) | Bulkfeeds: RSS directory link checking | C | Info |
| BullsEye | BullsEye/Intelliseek robot | R | Info |
| bumblebee@relevare.com | Relevare Portal software robot | R | Info |
| BunnySlippers | Microsoft server information robot (see link) | C | Info |
| BurstFindCrawler/1.1 (crawler.burstfind.com; http://crawler.burstfind.com; crawler@burstfind.com) | BurstFind search crawler (64.34.172.xx) | R | Info |
| Buscaplus Robi/1.0 (http://www.buscaplus.com/robi/) | Buscaplus (Spain) robot | R | Info |
| BW-C-2.0 | Logitech Desktop Managers (LDM) Backweb (BW) update check | D | Info |
| bwh3_user_agent | Basic Web Hacking 3 fake user-agent from Hellbound Hackers challenges | S | Info |
| Cabot/Nutch-0.9 (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com) | Amfibi Search robot | R | Info |
| Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com) | Amfibi Search robot | R | Info |
| CamelHttpStream/1.0 | Evolution integrated mail solution Camel TCP stream class | Info | |
| Cancer Information and Support International; | Some user agent | Info | |
| carleson/1.0 | Cosmix project crawler (204.14.48.x / 38.113.234.xxx) | R | Info |
| Carnegie_Mellon_University_Research_WebBOT-->PLEASE READ-->http://www.andrew.cmu.edu/~brgordon/webbot/index.html http://www.andrew.cmu.edu/~brgordon/webbot/index.html | Carnegie Mellon University WebBOT | R | Info |
| Carnegie_Mellon_University_WebCrawler http://www.andrew.cmu.edu/~brgordon/webbot/index.html | Carnegie Mellon University WebBOT | R | Info |
| Catall Spider | Catall.de search & web directory (Germany) | R | Info |
| CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com) | UIUCs Cazoodle search based on MetaQuerier | R | Info |
| CCBot/1.0 (+http://www.commoncrawl.org/bot.html) | CommonCrawl Foundation search crawler | R | Info |
| ccubee/x.x | Empyreum Ccubee (Czech) search engine solution | R | Info |
| CDR/1.7.1 Simulator/0.7(+http://timewe.net) Profile/MIDP-1.0 Configuration/CLDC-1.0 | Timewe mobile browser (WAP) simulator (Japan) | B | Info |
| CE-Preload | Cisco Content Engine | P | Info |
| CentiverseBot | Nordic semantic search engine | C | Info |
| CentiverseBot - investigator | Nordic semantic search engine | C | Info |
| CentiverseBot/3.0 (http://www.centiverse-project.net) | Nordic semantic search engine | C | Info |
| Ceramic Tile Installation Guide (http://www.floorstransformed.com) | Floortransformed.com robot (link ckecking ??) | R | Info |
| CERN-LineMode/2.15 | CERN Line Mode Browser | B | Info |
| cfetch/1.0 | Cosmix project crawler (204.14.48.x / 38.113.234.xxx) | R | Info |
| CFNetwork/x.x | MaxOS X CoreFoundation CFNetwork API | Info | |
| cg-eye interactive | cg-eye CGI checker | C | Info |
| Charon/1.x (Amiga) | Charon Amiga download manager | D | Info |
| Chat Catcher/1.0 | Chat Catcher blog monitoring robot | C | Info |
| Checkbot/1.xx LWP/5.xx | Checkbot link validation | C | Info |
| CheckLinks/1.x.x | Checklinks - Perl link checker | C | Info |
| CheckUrl | NTL user agent | Info | |
| CheckWeb | CheckWeb link validation | C | Info |
| Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp) | Chilkat HTTP component user-agent | Info | |
| China Local Browse 2.6 | Unknown spam bot from telekom.com.my (218.111.83.xxx) | S | Info |
| Chitika ContentHit 1.0 | Chitika Inc. Blog advertising | C | Info |
| ChristCRAWLER 2.0 | Christcentral.com Christcrawler (was www.christcrawler.com) | R | Info |
| CHttpClient by Open Text Corporation | CHttpClient - C++ class using WinInet | Info | |
| CipinetBot (http://www.cipinet.com/bot.html) | CipinetBot -Cipinet Search Engine Web Crawler | R | Info |
| Cityreview Robot (+http://www.cityreview.org/crawler/) | Cityreview regional search (Germany) link checking | C | Info |
| CJ Spider/ | Commision Junction link checking spider | C | Info |
| CJB.NET Proxy | CJB Net anonymous socks proxy service (216.194.70.x) | P | Info |
| ClariaBot/1.0 | Claria (ex Gator) SearchScout robot (64.152.73.xx) | R | Info |
| Claymont.com | Claymont Search robot | R | Info |
| CloakDetect/0.9 (+http://fulltext.seznam.cz/) | Seznam Search (Czech Republic) robot | R | Info |
| Clushbot/2.x (+http://www.clush.com/bot.html) | Clush clustered search robot | R | Info |
| Clushbot/3.x-BinaryFury (+http://www.clush.com/bot.html) | Clush clustered search robot | R | Info |
| Clushbot/3.xx-Ajax (+http://www.clush.com/bot.html) | Clush clustered search robot | R | Info |
| Clushbot/3.xx-Hector (+http://www.clush.com/bot.html) | Clush clustered search robot | R | Info |
| Clushbot/3.xx-Peleus (+http://www.clush.com/bot.html) | Clush clustered search robot | R | Info |
| COAST WebMaster Pro/4.x.x.xx (Windows NT) | COAST Webmaster - Web management and maintenance software | C | Info |
| CoBITSProbe | Proposed Content-Based Image Tracking System (CoBITS) P2P crawler | R C | Info |
| Cocoal.icio.us/1.0 (v36) (Mac OS X; http://www.scifihifi.com/cocoalicious) | Cocoa del.icio.us (social bookmarks manager) client for Mac OS X | C | Info |
| Cogentbot/1.X (+http://www.cogentsoftwaresolutions.com/bot.html) | Cogent Search Bot from Cogent Software Solutions for unknown purposes | R | Info |
| ColdFusion | Cold Fusion server used by various IPs i.e.: - NetWORLD web catalogue link checking | P C | Info |
| ColdFusion (BookmarkTracker.com) | Cold Fusion server used by Bookmark Tracker - online favourites managment | C | Info |
| collage.cgi/1.xx | WebCollage Syndicator graphics crawler/collector | R D | Info |
| combine/0.0 | Combine harvesting & indexing robot | R | Info |
| Combine/2.0 http://combine.it.lth.se/ | Combine harvesting & indexing robot | R | Info |
| Combine/3 http://combine.it.lth.se/ | Combine harvesting & indexing robot | R | Info |
| Combine/x.0 | Combine harvesting & indexing robot | R | Info |
| cometrics-bot, http://www.cometrics.de | cometrics Web Content Mining solution - Germany | R | Info |
| Commerce Browser Center | Wildsoft Germany (closed) Internet client system user-agent (was www.oskarweb.de) | B | Info |
| complex_network_group/Nutch-0.9-dev (discovering the structure of the world-wide-web; http://cantor.ee.ucla.edu/~networks/crawl; nimakhaj@gmail.com) | UCLA Complex Networks Groups Complex Network Analysis | C | Info |
| Computer_and_Automation_Research_Institute_Crawler crawler@ilab.sztaki.hu | Hungarian Academy of Sciences data mining search | R | Info |
| Comrite/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org) | ComRite Chinese Search Engine for Oversea Web Sites (69.248.26.xx) | R | Info |
| Contact | unknown | Info | |
| ContactBot/0.2 | Probably E-Mail harvesting robot - same as LMQueueBot | S | Info |
| ContentSmartz | ContentSmartz e-mail harvesting tools | S | Info |
| contype | Internet Explorer versions 4.x and 5 plugin content | B | Info |
| Convera Internet Spider V6.x | Converas RetrievalWare Internet Spider (63.241.61.x) | R | Info |
| ConveraCrawler/0.2 | Converas RetrievalWare Internet Spider (63.241.61.x) | R | Info |
| ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl) | Converas RetrievalWare Internet Spider (63.241.61.x) | R | Info |
| ConveraMultiMediaCrawler/0.1 (+http://www.authoritativeweb.com/crawl) | Converas RetrievalWare Internet Spider (63.241.61.x) | R | Info |
| CoolBot | Suchmaschine21 (Germany) robot | R | Info |
| Cooliris/1.5 CFNetwork/459 Darwin/10.0.0d3 | Cooliris photo and video browser | B | Info |
| CoralWebPrx/0.1.1x (See http://coralcdn.org/) | Coral Content Distribution Network | P C | Info |
| cosmos/0.8_(robot@xyleme.com) | Xyleme SA France robot | R | Info |
| cosmos/0.9_(robot@xyleme.com) | Xyleme SA France robot | R | Info |
| CoteoNutchCrawler/Nutch-0.9 (info [at] coteo [dot] com) | Coteo.com - local French directory link checking | C | Info |
| CougarSearch/0.x (+http://www.cougarsearch.com/faq.shtml) | Cougarsearch.com robot | R | Info |
| Covac TexAs Arachbot | Covac Arachnid Web Crawler | R | Info |
| CoverScout%203/3.0.1 CFNetwork/339.5 Darwin/9.5.0 (i386) (iMac5,1) | CoverScout for iTunes - CD cover search tool | B | Info |
| Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) | Naver Japan / Korea robot | R | Info |
| Cowbot-0.1.x (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com) | Naver Japan / Korea robot | R | Info |
| CrawlConvera0.1 (CrawlConvera@yahoo.com) | Converas RetrievalWare Internet Spider | R | Info |
| Crawler | unknown robot via Level3.net | Info | |
| Crawler (cometsearch@cometsystems.com) | Cometsystems Comet Search robot via Findwhat (now Miva) | R | Info |
| Crawler admin@crawler.de | Crawler.de / Abacho robot | R | Info |
| Crawler V 0.2.x admin@crawler.de | Crawler.de / Abacho robot | R | Info |
| crawler@alexa.com | Alexa crawler | R | Info |
| CrawlerBoy Pinpoint.com | Pinpoint WAP search robot | R | Info |
| Crawllybot/0.1 (Crawllybot; +http://www.crawlly.com; crawler@crawlly.com) | Crawlly Beta search - Germany (72.232.194.2xx) | R | Info |
| CreativeCommons/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) | Creatice Commons using Nutch open source robot | R | Info |
| Cricket-A100/1.0 UP.Browser/6.3.0.7 (GUI) MMP/2.0 | Cricket A100 cell phone browser | B | Info |
| CrocCrawler vx.3 [en] (http://www.croccrawler.com) (X11; I; Linux 2.0.44 i686) | Croccrawler robot | R | Info |
| csci_b659/0.13 | Web mining project from CSCI 659 (computer science course) at Indiana Univerity | R | Info |
| CSE HTML Validator Professional (http://www.htmlvalidator.com/) | CSE HTML Validator for Windows | C | Info |
| Cuam Ver0.050bx | Cuam - IE based browser | B | Info |
| Cuasarbot/0.9b http://www.cuasar.com/spider_beta/ | Cuasar (Spain) music / ringtone search spider | R | Info |
| curl/7.10.x (i386-redhat-linux-gnu) libcurl/7.10.x OpenSSL/0.9.7a ipv6 zlib/1.1.4 | Curl file transferring tool | D | Info |
| curl/7.7.x (i386--freebsd4.3) libcurl 7.7.x (SSL 0.9.6) (ipv6 enabled) | Curl file transferring tool | D | Info |
| curl/7.8 (i686-pc-linux-gnu) libcurl 7.8 (OpenSSL 0.9.6) | Curl file transferring tool | D | Info |
| curl/7.9.x (win32) libcurl 7.9.x | Curl file transferring tool | D | Info |
| CurryGuide SiteScan 1.1 | CurryGuide UK link check robot | R | Info |
| Custo x.x (www.netwu.com) | Custo web site spidering tool (link checking) | C | Info |
| Custom Spider www.bisnisseek.com /1.0 | Bisnisseek (was www.bisnisseek.com) robot | R | Info |
| Cyberdog/2.0 (Macintosh; 68k) | Cyberdog Mac Browser (was www.cyberdog.org) | B | Info |
| CyberPatrol SiteCat Webbot (http://www.cyberpatrol.com/cyberpatrolcrawler.asp) | CyberPatrol LLC robot for web filtering software | R | Info |
| CyberSpyder Link Test/2.1.12 (admin@mspennyworth.com) | CyberSpyder Link Test software | C | Info |
| CydralSpider/1.x (Cydral Web Image Search; http://www.cydral.com) | Cydral image & site search spider | R | Info |
| CydralSpider/3.0 (Cydral Image Search; http://www.cydral.com) | Cydral image & site search spider | R | Info |
| DA 3.5 (www.lidan.com) | Downloadaccelerator download manager | D | Info |
| DA 4.0 | Downloadaccelerator download manager | D | Info |
| DA 4.0 (www.downloadaccelerator.com) | Downloadaccelerator download manager | D | Info |
| DA 5.0 | Downloadaccelerator download manager | D | Info |
| DA 7.0 | Downloadaccelerator download manager | D | Info |
| DAP x.x | Download Accelerator Plus download manager | D | Info |
| Dart Communications PowerTCP | PowerTCP ActiveX control tool | Info | |
| DataCha0s/2.0 | Unknown bot from Kornet Korea (218.149.129.xxx) scans for Perl Awstats | S | Info |
| DataCha0s/2.0 | Unknown UA looking for Awstats Perl components | S | Info |
| DataFountains/DMOZ Downloader | INFOMINE/iVia Scholary Internet Resource Collections robot | R | Info |
| DataFountains/Dmoz Downloader (http://ivia.ucr.edu/useragents.shtml) | INFOMINE/iVia Scholary Internet Resource Collections robot | R | Info |
| DataFountains/DMOZ Feature Vector Corpus Creator (http://ivia.ucr.edu/useragents.shtml) | INFOMINE/iVia Scholary Internet Resource Collections robot | R | Info |
| DataparkSearch/4.47 (+http://dataparksearch.org/bot) | DataparkSearch open source search engine | R | Info |
| DataparkSearch/4.xx (http://www.dataparksearch.org/) | DataparkSearch open source search engine | R | Info |
| DataSpear/1.0 (Spider; http://www.dataspear.com/spider.html; spider@dataspear.com) | DataSpear Directory robot (24.109.29.xx) | R | Info |
| DataSpearSpiderBot/0.2 (DataSpear Spider Bot; http://dssb.dataspear.com/bot.html; dssb@dataspear.com) | DataSpear Directory robot (24.109.29.xx) | R | Info |
| DatenBot( http://www.sicher-durchs-netz.de/bot.html) | Sicher-durchs-Netz German security related search (62.75.220.xxx) | R | Info |
| DaviesBot/1.7 (www.wholeweb.net) | Wholeweb robot | R | Info |
| daypopbot/0.x | Daypop blog - weblog - online mag search spider | R | Info |
| dbDig(http://www.prairielandconsulting.com) | dbDig search engine | R | Info |
| DBrowse 1.4b | Some site scanning tool via diff. IPs i.e.: - wanweb.net (208.6.163.xxx) - cox.net (68.4.xxx.xxx) | S | Info |
| DBrowse 1.4d | Some site scanning tool via diff. IPs i.e.: - pacbell.net (67.112.xxx.xxx) | S | Info |
| DC-Sakura/x.xx | DC-Sakura download manager | D | Info |
| dCSbot/1.1 | unknown divine/Openmarket.com robot | R | Info |
| DDD | some (website) downloading tool | D | Info |
| dds explorer v1.0 beta | Unknown user agent | Info | |
| de.searchengine.comBot 1.2 (http://de.searchengine.com/spider) | Searchengine.com (Germany) submission checking / robot (84.73.57.xx) | R | Info |
| DeadLinkCheck/0.4.0 libwww-perl/5.xx | DLC Perl HTTP link checking | C | Info |
| Deep Link Calculator v1.0 | Sootle Web Directory deep link checker | C | Info |
| deepak-USC/ISI | deepak-USC/ISI robot from USC/Information Science Institute | R | Info |
| DeepIndex | Deepindex robot | R | Info |
| DeepIndex ( http://www.zetbot.com ) | Zetbot search Belgium (213.41.128.xx) using Deepindex robot | R | Info |
| DeepIndex (www.en.deepindex.com) | Deepindex robot | R | Info |
| DeepIndexer.ca | Deepindex robot (via Paragon.net Canada) | R | Info |
| del.icio.us-thumbnails/1.0 Mozilla/5.0 (compatible; Konqueror/3.4; FreeBSD) KHTML/3.4.2 (like Gecko) | del.icio.us picture robot for thumbnail preview via Yahoo | D | Info |
| DeleGate/9.0.5-fix1 | DeleGate application level gateway / proxy server | P | Info |
| Demo Bot DOT 16b | Some site scanning tool from 217.34.59.xxx (btopenworld.com) | S | Info |
| Demo Bot Z 16b | Some site scanning tool from 68.154.96.xx (bellsouth.net) | S | Info |
| Denmex websearch (http://search.denmex.com) | Denmex Websearch robot/link checking | R | Info |
| Der große BilderSauger 2.00u | DataBecker Bilder Sauger (discontinued) web graphics downloader | D | Info |
| dev-spider2.searchpsider.com/1.3b | Searchspider.com robot (72.245.225.xxx) | R | Info |
| DevComponents.com HtmlDocument Object | DevComponents HTMLDocument Class Library for Visual Studio.net | Info | |
| DiaGem/1.1 (http://www.skyrocket.gr.jp/diagem.html) | DiaGem Japan web crawler | R | Info |
| Diamond/x.0 | Claria (ex Gator) SearchScout robot (64.152.73.xx) | R | Info |
| DiamondBot | Claria (ex Gator) SearchScout robot (64.152.73.xx) | R | Info |
| Digger/1.0 JDK/1.3.0rc3 | Diggit! robot | R | Info |
| DigOut4U | OpenPortal4U robot | R | Info |
| DIIbot/1.2 | Findsame.com (site is offline) / Digital-Integrity robot | R | Info |
| Dillo/0.8.5-i18n-misc | Dillo Web Browser | B | Info |
| Dillo/0.x.x | Dillo Web Browser | B | Info |
| disastrous/1.0.5 (running with Python 2.5.1; http://www.bortzmeyer.org/disastrous.html; archangel77@del.icio.us) | disastrous - a del.icio.us link checker based on Python | C | Info |
| DISCo Pump x.x | DISCo Pump offline browser / website ripper | D | Info |
| disco/Nutch-0.9 (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com) | Unkown robot from Discovery Engine Corp. | R | Info |
| disco/Nutch-1.0-dev (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com) | Unkown robot from Discovery Engine Corp. | R | Info |
| DittoSpyder | Ditto picture search robot | R | Info |
| dlman | some download agent | D | Info |
| dloader(NaverRobot)/1.0 | Naver Japan / Korea robot | R | Info |
| DNSRight.com WebBot Link Ckeck Tool. Report abuse to: dnsr@dnsright.com | DNS Right - Online DNS tools | C | Info |
| DoCoMo/1.0/Nxxxi/c10 | NTT DoCoMo (Japan) robot | R | Info |
| DoCoMo/1.0/Nxxxi/c10/TB | NTT DoCoMo (Japan) robot | R | Info |
| DoCoMo/1.0/P502i/c10 (Google CHTML Proxy/1.0) | Google (216.239.39.x) proxy server | P | Info |
| DoCoMo/2.0 P900iV(c100;TB;W24H11) | NTT DoCoMo (Japan) robot | R | Info |
| DoCoMo/2.0 SH901iS(c100;TB;W24H12),gzip(gfe) (via translate.google.com) | NTT DoCoMo (Japan) proxy server (210.136.161.1xx) | P | Info |
| DoCoMo/2.0 SH902i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html) | Yahoo Search Japan robot (203.216.197.xxx) | R | Info |
| DoCoMo/2.0/SO502i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html) | Yahoo Search Japan robot (203.216.197.xxx) | R | Info |
| DocZilla/1.0 (Windows; U; WinNT4.0; en-US; rv:1.0.0) Gecko/20020804 | DocZilla - Mozilla-based SGML/XML/HTML- browser | B | Info |
| dodgebot/experimental | unknown robot from AGMLAB Information Technologies (Information retrieval system ?) | R | Info |
| DonutP; Windows98SE | Donut P - Japanese IE based browser | B | Info |
| Doubanbot/1.0 (bot@douban.com http://www.douban.com) | Unknown robot from douban search (China) - maybe image crawling | Info | |
| Download Demon/3.x.x.x | Download Demon/Netzip download manager | D | Info |
| Download Druid 2.x | Download Druid IE plugin download manager | D | Info |
| Download Express 1.0 | Download Express download manager | D | Info |
| Download Master | Download Master download manager | D | Info |
| Download Ninja 3.0 | Download Ninja download manager (Japan) | D | Info |
| Download Wonder | Download Wonder download manager | D | Info |
| Download-Tipp Linkcheck (http://download-tipp.de/) | Download-Tipp Germany link checking | R | Info |
| Download.exe(1.1) (+http://www.sql-und-xml.de/freeware-tools/) | download.exe .NET based downloading tool | D | Info |
| DownloadDirect.1.0 | Download Direct download manager | D | Info |
| Dr.Web (R) online scanner: http://online.drweb.com/ | Dr.WEB online virus scanner | Info | |
| Dragonfly File Reader | Dragonfly CMS - Open Source content management system | B | Info |
| Drecombot/1.0 (http://career.drecom.jp/bot.html) | Drecom Japan (210.233.67.xxx) - Blog search ?? | R | Info |
| Drupal (+http://drupal.org/) | Drupal - open source content management platform | C | Info |
| DSurf15a 01 | Some site scanning tool via diff. IPs i.e.: - cox.net (68.5.xxx.xxx) - pacbell.net (64.16x.xxx.xxx) | S | Info |
| DSurf15a 71 | Some site scanning tool via diff. IPs i.e.: - cox.net (68.4.xxx.xxx) | S | Info |
| DSurf15a 81 | Some site scanning tool via diff. IPs i.e.: - verizon.net (4.47.xxx.xxx) | S | Info |
| DSurf15a VA | Some site scanning tool via diff. IPs i.e.: - eastlink.ca (24.222.xxx.xxx) - cogeco.net (216.221.8x.xxx) | S | Info |
| DTAAgent | DTAAgent Java object for data collecting | R D | Info |
| dtSearchSpider | dt Search Spider software | R | Info |
| Dual Proxy | Fourelle Venturi proxy server | P | Info |
| DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html) | Duck Duck Go search crawler | R | Info |
| Dumbot(version 0.1 beta - dumbfind.com) | DumbFind.com robot | R | Info |
| Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html) | DumbFind.com robot | R | Info |
| Dumbot(version 0.1 beta) | DumbFind.com robot | R | Info |
| e-sense 1.0 ea(www.vigiltech.com/esensedisclaim.html) | Vigiltech e-Sense user research robot (website is offline) | R | Info |
| e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/) | e-Society Project (Japan) crawler (133.9.238.xx) | R | Info |
| eApolloBot/2.0 (compatible; heritrix/2.0.0-SNAPSHOT-20071024.170148 +http://www.eapollo-opto.com) | Global Opto's eApollo Flash based search engine - Taiwan | R | Info |
| EARTHCOM.info/1.x [www.earthcom.info] | Earthcom (Czech Republic) search robot (194.108.39.xx) | R | Info |
| EARTHCOM.info/1.xbeta [www.earthcom.info] | Earthcom (Czech Republic) search robot (194.108.39.xx) | R | Info |
| EasyDL/3.xx | Keywen Encyclopedia Bot | R | Info |
| EasyDL/3.xx http://keywen.com/Encyclopedia/Bot | Keywen Encyclopedia Bot | R | Info |
| EBrowse 1.4b | Some site scanning tool via diff. IPs i.e.: - swbell.net (65.66.xxx.xxx) | S | Info |
| eCatch/3.0 | eCatch (now Wysigot) offline browser | B D | Info |
| EchO!/2.0 | Echo.fr robot | R | Info |
| Educate Search VxB | Some site scanning tool via diff. IPs i.e.: - cox.net (68.4.xxx.xxx) | S | Info |
| egothor/3.0a (+http://www.xdefine.org/robot.html) | Xdefine text search engine robot - based on Egothor open source crawler | R | Info |
| EgotoBot/4.8 (+http://www.egoto.com/about.htm) | Egoto Search robot | R | Info |
| ejupiter.com | eJupiter searcg robot (206.191.49.xx) | R | Info |
| EldoS TimelyWeb/3.x | TimelyWeb web page monitoring tool | C | Info |
| elfbot/1.0 (+http://www.uchoose.de/crawler/elfbot/) | Elftales crawler for uChoose theme based search (Germany) | R | Info |
| ELI/20070402:2.0 (DAUM RSS Robot, Daum Communications Corp.; +http://ws.daum.net/aboutkr.html) | DAUMOA - RSS search robot of Daum | R | Info |
| ELinks (0.x.x; Linux 2.4.20 i586; 132x60) | ELinks text mode browser | B | Info |
| ELinks/0.x.x (textmode; NetBSD 1.6.2 sparc; 132x43) | ELinks text mode browser | B | Info |
| EmailSiphon | Sonic E-mail collector | S | Info |
| EmailSpider | EmailSpider E-mail harvesting software | S | Info |
| EmailWolf 1.00 | Trellian EMailWolf E-mail collector | S | Info |
| EmeraldShield.com WebBot | EmeraldShield spam and web filtration services | P R | Info |
| EmeraldShield.com WebBot (http://www.emeraldshield.com/webbot.aspx) | EmeraldShield spam and web filtration services | P R | Info |
| EMPAS_ROBOT | Empas search Korea robot (220.95.22x.xxx) | R | Info |
| EnaBot/1.x (http://www.enaball.com/crawler.html) | Enabot - Enaball semantic search project crawler | R | Info |
| endo/1.0 (Mac OS X; ppc i386; http://kula.jp/endo) | endo - Mac news site and blog aggregator | B | Info |
| Enfish Tracker | Enfish Personal search tool | R | Info |
| Enterprise_Search/1.0 | Enterprise Search engine software (64.202.165.xxx) | R | Info |
| Enterprise_Search/1.0.xxx | Enterprise Search engine software (64.202.165.xxx) | R | Info |
| Enterprise_Search/1.00.xxx;MSSQL (http://www.innerprise.net/es-spider.asp) | Enterprise Search engine software (64.202.165.xxx) | R | Info |
| envolk/1.7 (+http://www.envolk.com/envolkspiderinfo.php) | Envolk Web Search robot | R | Info |
| envolk[ITS]spider/1.6(+http://www.envolk.com/envolkspider.html) | Envolk Web Search robot | R | Info |
| EroCrawler | EroCrawler adult search robot | R | Info |
| ES.NET_Crawler/2.0 (http://search.innerprise.net/) | Enterprise Search engine software (64.202.165.xxx) | R | Info |
| eseek-larbin_2.6.2 (crawler@exactseek.com) | ExactSEEK (Jayde Online) robot | R | Info |
| ESISmartSpider | ESI Smart-Spider toolkit | R | Info |
| eStyleSearch 4 (compatible; MSIE 6.0; Windows NT 5.0) | e-Style ISP search (Russia) robot (217.174.103.xxx) | R | Info |
| ESurf15a 15 | Some site scanning tool via diff. IPs | S | Info |
| EuripBot/0.x (+http://www.eurip.com) GetFile | Eurip.com - European Internet Portal robot | R | Info |
| EuripBot/0.x (+http://www.eurip.com) GetRobots | Eurip.com - European Internet Portal robot | R | Info |
| EuripBot/0.x (+http://www.eurip.com) PreCheck | Eurip.com - European Internet Portal robot | R | Info |
| Eurobot/1.0 (http://www.ayell.eu) | Ayell Euronet business directory robot | R | Info |
| EvaalSE - bot@evaal.com | Evaal Search Engine robot | R | Info |
| eventax/1.3 (eventax; http://www.eventax.de/; info@eventax.de) | Eventax event search (Germany) | R | Info |
| Everest-Vulcan Inc./0.1 (R&D project; host=e-1-24; http://everest.vulcan.com/crawlerhelp) | Vulcan Inc. Everest crawler (in development) | R | Info |
| Everest-Vulcan Inc./0.1 (R&D project; http://everest.vulcan.com/crawlerhelp) | Vulcan Inc. Everest crawler (in development) | R | Info |
| Exabot-Images/1.0 | Exalead Websearch image crawler (193.47.80.xx) | R | Info |
| Exabot-Test/1.0 | Exalead (France) search robot (193.47.80.xx) | R | Info |
| Exabot/2.0 | Exalead (France) search robot (193.47.80.xx) | R | Info |
| Exabot/3.0 | Exalead (France) search robot (193.47.80.xx) | R | Info |
| ExactSearch | eXact Search Bar for IE | B | Info |
| ExactSeek Crawler/0.1 | ExactSEEK (Jayde Online) robot | R | Info |
| exactseek-crawler-2.63 (crawler@exactseek.com) | ExactSEEK (Jayde Online) robot | R | Info |
| exactseek-pagereaper-2.63 (crawler@exactseek.com) | ExactSEEK (Jayde Online) robot | R | Info |
| exactseek.com | ExactSEEK (Jayde Online) robot (69.9.181.1xx) | R | Info |
| Exalead NG/MimeLive Client (convert/http/0.120) | Exalead (France) search robot (193.47.80.xx) | R | Info |
| Excalibur Internet Spider V6.5.4 | Excalibur (now Convera) spider software | R | Info |
| Execrawl/1.0 (Execrawl; http://www.execrawl.com/; bot@execrawl.com) | Execrawl software search using nutch | R | Info |
| exooba crawler/exooba crawler (crawler for exooba.com; http://www.exooba.com/; info at exooba dot com) | exooba crawler for exooba search pre-alpha development | R | Info |
| exooba/exooba crawler (exooba; exooba) | exooba crawler for exooba search pre-alpha development | R | Info |
| ExperimentalHenrytheMiragoRobot | Mirago UK Robot | R | Info |
| Expired Domain Sleuth | Expired Domain Sleuth domain name tool | R C | Info |
| Express WebPictures (www.express-soft.com) | Express Web Pictures image browser | B D | Info |
| ExtractorPro | Extractor Pro e-mail collector | S | Info |
| Extreme Picture Finder | Exisoftware image grabber and downloading tool | D | Info |
| EyeCatcher (Download-tipp.de)/1.0 | Download-Tipp Germany robot | R | Info |
| Factbot 1.09 (see http://www.factbites.com/webmasters.php) | Factbites search robot | R | Info |
| factbot : http://www.factbites.com/robots | Factbites search robot | R | Info |
| FaEdit/2.0.x | FaEdit Professional - Japanese bookmark manager | C | Info |
| FairAd Client | FairAd user | P | Info |
| FANGCrawl/0.01 | Safe-t.net web filtering service | P | Info |
| FARK.com link verifier | Drew Curtis' FARK.com link checking | C | Info |
| Fast Crawler Gold Edition | Fast/Alltheweb crawler (66.151.181.xx) | R | Info |
| FAST Enterprise Crawler 6 (Experimental) | Fast/Alltheweb crawler (66.151.181.xx) | R | Info |
| FAST Enterprise Crawler 6 / Scirus scirus-crawler@fast.no; http://www.scirus.com/srsapp/contactus/ | Fast Enterprise Crawler (66.151.181.xx) for Scirus scienctific information search | R | Info |
| FAST Enterprise Crawler 6 used by Cobra Development (admin@fastsearch.com) | Fast/Alltheweb crawler (66.151.181.xx) | R | Info |
| FAST Enterprise Crawler 6 used by Comperio AS (sts@comperio.no) | Comperio Web Miner based on Fast ESP | R | Info |
| FAST Enterprise Crawler 6 used by FAST (FAST) | Fast/Alltheweb crawler (66.151.181.xx) | R | Info |
| FAST Enterprise Crawler 6 used by Pages Jaunes (pvincent@pagesjaunes.fr) | Pages Jaunes business search (France) robot using Fast Enterprise Crawler | R | Info |
| FAST Enterprise Crawler 6 used by Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au) | Fast/Alltheweb crawler for Sensis.com.au Australian search (66.151.181.xx) | R | Info |
| FAST Enterprise Crawler 6 used by Singapore Press Holdings (crawler@sphsearch.sg) | SPH Search - Singapore related search using Fast crawler | R | Info |
| FAST Enterprise Crawler 6 used by WWU (wardi@uni-muenster.de) | FAST Enterprise Crawler used by WWU (University of Muenster - Germany) | C | Info |
| FAST Enterprise Crawler/6 (www.fastsearch.com) | Fast/Alltheweb crawler (66.151.181.xx) | R | Info |
| FAST Enterprise Crawler/6.4 (helpdesk at fast.no) | Fast/Alltheweb crawler (66.151.181.xx) | R | Info |
| FAST FirstPage retriever (compatible; MSIE 5.5; Mozilla/4.0) | Fast/Alltheweb crawler (66.151.181.xx) | R | Info |
| FAST MetaWeb Crawler (helpdesk at fastsearch dot com) | Fast/Alltheweb crawler (66.151.181.xx) | R | Info |
| Fast PartnerSite Crawler | Fast/Alltheweb crawler (66.151.181.xx) | R | Info |
| FAST-WebCrawler/2.2.10 (Multimedia Search) (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) | Fast/Alltheweb multimedia crawler | R | Info |
| FAST-WebCrawler/2.2.6 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/2.2.7 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)http://www.fast.no | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/2.2.8 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)http://www.fast.no | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.2 test | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.3 (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.4/Nirvana (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.4/PartnerSite (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.5 (atw-crawler at fast dot no; http://fast.no/support.php?c=faqs/crawler) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.6/FirstPage (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.7 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp) | Fast/Alltheweb crawler | R | Info |
| FAST-WebCrawler/3.x Multimedia | Fast/Alltheweb multimedia crawler | R | Info |
| FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no) | Fast/Alltheweb multimedia crawler | R | Info |
| fastbot crawler beta 2.0 (+http://www.fastbot.de) | Fastbot search Germany crawler (80.252.104.1xx) | R | Info |
| FastBug http://www.ay-up.com | Ay-Up geo sync search robot | R | Info |
| FastCrawler 3.0.1 (crawler@1klik.dk) | Fast/Alltheweb crawler (66.151.181.xx) | R | Info |
| FastSearch Web Crawler for Verizon SuperPages (kevin.watters@fastsearch.com) | Fast/Alltheweb crawler used by SuperPages.com | R | Info |
| Favcollector/2.0 (info@favcollector.com http://www.favcollector.com/) | Favcollector Favicon collecting robot | R | Info |
| FavIconizer | FavIconizer - IE favorites icons refreshing tool | D | Info |
| favo.eu crawler/0.6 (http://www.favo.eu) | favo.eu (Germany) search robot | R | Info |
| FavOrg | ZD's FavOrg favourites managing program | C | Info |
| Favorites Checking (http://campulka.net) | Campulka.net Favorites checking tool | C | Info |
| Favorites Sweeper v.2.03 | Favorites Sweeper bookmark checker | C | Info |
| Faxobot/1.0 | FaXo Search robot (69.152.89.xx) | R | Info |
| FDM 1.x | Free Download Manager (FDM) download accelerator | D | Info |
| FDM 2.x | Free Download Manager (FDM) download accelerator | D | Info |
| Feed Seeker Bot (RSS Feed Seeker http://www.MyNewFavoriteThing.com/fsb.php) | RSS Feed Seeker bot (68.225.95.2xx) | R | Info |
| Feed24.com | Feed24 news feed and blog search | R | Info |
| Feed::Find/0.0x | Feed::Find - Syndication feed (RSS/Atom) auto-discovery | D | Info |
| Feedable/0.1 (compatible; MSIE 6.0; Windows NT 5.1) | Feedable beta web based RSS service | B | Info |
| FeedChecker/0.01 | Unknown robot from the University of Tokyo (157.82.157.xx) | R | Info |
| FeedDemon/2.7 (http://www.newsgator.com/; Microsoft Windows XP) | FeedDemon RSS reader | B | Info |
| Feedfetcher-Google-iGoogleGadgets; (+http://www.google.com/feedfetcher.html) | Google news feed feetcher for iGoogle gadgets | C | Info |
| Feedfetcher-Google; (+http://www.google.com/feedfetcher.html) | Google Feedfetcher - RSS and Atom feed crawler | R | Info |
| FeedForAll rss2html.php v2 | FeedForAll RSS feed robot | C | Info |
| FeedHub FeedDiscovery/1.0 (http://www.feedhub.com) | FeedHub news feed personalization engine powered by mSpoke | R | Info |
| FeedHub MetaDataFetcher/1.0 (http://www.feedhub.com) | FeedHub news feed personalization engine powered by mSpoke | R | Info |
| Feedjit Favicon Crawler 1.0 | Feedjit news feed service favicon crawler | R | Info |
| Feedreader 3.xx (Powered by Newsbrain) | Newsbrain Feedreader3 | B | Info |
| Feedshow/x.0 (http://www.feedshow.com; 1 subscriber) | FeedShow online RSS feed reader | B | Info |
| FeedshowOnline (http://www.feedshow.com) | FeedShow online RSS feed reader | B | Info |
| FeedZcollector v1.x (Platinum) http://www.feeds4all.com/feedzcollector | FeedZcollector - Feed (RSS, ATOM and RDF) capturing software | B | Info |
| Felix - Mixcat Crawler (+http://mixcat.com) | MixCat robot | R | Info |
| fetch libfetch/2.0 | FreeBSD download tool | D | Info |
| FFC Trap Door Spider | Frequent Finders spider via Sitefusion.com | R | Info |
| Filangy/0.01-beta (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com) | Filangy search and bookmark service | R C | Info |
| Filangy/1.0x (Filangy; http://www.filangy.com/filangyinfo.jsp?inc=robots.jsp; filangy-agent@filangy.com) | Filangy search and bookmark service | R C | Info |
| Filangy/1.0x (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com) | Filangy search and bookmark service | R C | Info |
| fileboost.net/1.0 (+http://www.fileboost.net) | File Boost Network link checking | R C | Info |
| FileHound x.x | FileHound download manager | D | Info |
| Filtrbox/1.0 | filtrbox media content (news) monitoring | R | Info |
| FindAnISP.com_ISP_Finder_v99a | Find An ISP robot | R C | Info |
| Findexa Crawler (http://www.findexa.no/gulesider/article26548.ece) | Yelo.no business search (Norway) via Findexa | R | Info |
| findlinks/x.xxx (+http://wortschatz.uni-leipzig.de/findlinks/) | NextLinks - German vocabulary and hyperlink search | R | Info |
| FineBot | Finesearch robot | R | Info |
| Finjan-prefetch | Finjan Vital Security Web Appliance security solution | P | Info |
| Firefly/1.0 | Fireball.de robot | R | Info |
| Firefly/1.0 (compatible; Mozilla 4.0; MSIE 5.5) | Fireball.de robot | R | Info |
| Firefox (kastaneta03@hotmail.com) | Unknown robot from Czech Technical University Prague (147.32.141.xx) | R | Info |
| Firefox_1.0.6 (kasparek@naparek.cz) | Unknown robot from Czech Technical University Prague (147.32.141.xx) | R | Info |
| FirstGov.gov Search - POC:firstgov.webmasters@gsa.gov | AT&T/Fast Search robot for FirstGov (U.S.Government) portal | R | Info |
| firstsbot | Firstsfind Germany robot / link checking | R | Info |
| Flapbot/0.7.2 (Flaptor Crawler; http://www.flaptor.com; crawler at flaptor period com) | Flaptor information retrieval solutions robot | R | Info |
| FlashGet | JetCar/FlashGet download manager | D | Info |
| FLATARTS_FAVICO | FlatArts Favorites Icon Tool | C D | Info |
| Flexum spider | Flexum.ru search service | R | Info |
| Flexum/2.0 | Flexum.ru search service | R | Info |
| FlickBot 2.0 RPT-HTTPClient/0.3-3 | DivX.com Movie Find robot | R | Info |
| flunky | Metacarta / Cogent robot | R | Info |
| fly/6.01 libwww/4.0D | unknown | Info | |
| flyindex.net 1.0/http://www.flyindex.net | FLY Index Metasearch link checking | C | Info |
| FnooleBot/2.5.2 (+http://www.fnoole.com/addurl.html) | Fnoole news crawler | R | Info |
| FocusedSampler/1.0 | IBM's Almaden Research robot | R | Info |
| Folkd.com Spider/0.1 beta 1 (www.folkd.com) | folkd.com social search robot | R | Info |
| FollowSite Bot ( http://www.followsite.com/bot.html ) | FollowSite robot - website monitoring | C | Info |
| FollowSite.com ( http://www.followsite.com/b.html ) | FollowSite robot - website monitoring | C | Info |
| Fooky.com/ScorpionBot/ScoutOut; http://www.fooky.com/scorpionbots | Fooky search Scorpionbots robot (65.12.170.xxx) | R | Info |
| Francis/1.0 (francis@neomo.de http://www.neomo.de/) | Neomo Search (Germany) robot (85.10.197.1xx) | R | Info |
| Franklin Locator 1.8 | Some spam bot | S | Info |
| free-downloads.net download-link validator /0.1 | Free Downloads shareware directory link checking | C | Info |
| FreeFind.com-SiteSearchEngine/1.0 (http://freefind.com; spiderinfo@freefind.com) | FreeFind.com robot | R | Info |
| Frelicbot/1.0 +http://www.frelic.com/ | Frelics backlink checking bot (beta) | C | Info |
| FreshDownload/x.xx | Fresh Download download manager | D | Info |
| FreshNotes crawler< report problems to crawler-at-freshnotes-dot-com | FreshNotes - music related artist search (72.3.225.xx) | R | Info |
| FSurf15a 01 | Some site scanning tool via diff. IPs | S | Info |
| FTB-Bot http://www.findthebest.co.uk/ | Find the Best search robot | R | Info |
| Full Web Bot 0416B | Some site scanning tool from diff. IPs i.e.: - 66.28.240.xx (cogentco.com) - 68.5.174.xx (cox.net) | S | Info |
| Full Web Bot 0516B | Some site scanning tool i.e. from - 68.154.96.xx (bellsouth.net) | S | Info |
| Full Web Bot 2816B | Some site scanning tool from 66.255.6.xxx (uslec.com) | S | Info |
| FuseBulb.Com | FuseBulb search | R | Info |
| FyberSpider (+http://www.fybersearch.com/fyberspider.php) | FyberSearch FyberSpider robot | R | Info |
| unknownght.com Web Server IIS vs Apache Survey. See Results at www.DNSRight.com | DNS Right - Online DNS tools | C | Info |
|
|
||||||||||||||||||||
|
|
© 2002-2011Andreas Staeding |
a Psychedelix.com product |
Home || Links || Banners || Feedback & Additions || E-Mail
