RSS Feed   

xml

  XML Version
   from 10/29/2014

Add to Google

  Add to Google

The User-Agents List
Home || Links || Banners || Feedback & Additions || E-Mail

Search Database:

           Help

 

List of User-Agents (Spiders, Robots, Crawler, Browser) A - F:

A searchable database of user-agents as used by browsers, search-engines spiders and crawlers, web-directories, download managers, link checkers, proxy servers, web filtering tools, harvesters, spambots, badbots. Sorted by the user-agents names with informations about their type, purpose and origin. The info-field at every user-agents entry offers even more information. Recent additions and updates are at the top of each page. The numerous Mozilla variations are not included in the alphabetical assortment "M" and can be found at an own page.
new Because of the many requests for a text only version of the database I decided to make a XML version available. You'll find a permanent link at the top left.

A - F
G - M
Mozilla
N - S
T - Z

 

Legend:
B = Browser
C = Link-, bookmark-, server- checking D = Downloading tool
P = Proxy server, web filtering
R = Robot, crawler, spider
S = Spam or bad bot

RECENT ADDITIONS AND UPDATES:
Updated: 10/29/2014 22:38h

String

Description

Type

Info

Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (FM Scene 4.6.1)  FM Scene soccer fan pages plugin  Info
Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.2.3) Gecko/20100401 Firefox/3.6.3 (.NET CLR 3.5.30729) (Prevx 3.0.5)  PrevX security plugin    Info

A - F:

String

Description

Type

Info

!Susie (http://www.sync2it.com/susie)  Sync2It bookmark management & clustering engine  C R  Info
<a href='http://www.unchaos.com/'> UnChaos </a> From Chaos To Order Hybrid Web Search Engine.(vadim_gonchar@unchaos.com)  UnCHAOS search robot  Info
<a href='http://www.unchaos.com/'> UnChaos Bot Hybrid Web Search Engine. </a> (vadim_gonchar@unchaos.com)  UnCHAOS search robot  Info
<b> UnChaosBot From Chaos To Order UnChaos Hybrid Web Search Engine at www.unchaos.com </b> (info@unchaos.com)  UnCHAOS search robot  Info
<http://www.sygol.com/> http://www.sygol.com  Sygol Search (Italy) robot  Info
( Robots.txt Validator http://www.searchengineworld.com/cgi-bin/robotcheck.cgi )  SearchEngineWorld's robots.txt validator  Info
(DreamPassport/3.0; isao/MyDiGiRabi)  DreamCast DreamPassport browser  Info
(Privoxy/1.0)  Privoxy web proxy  Info
*/Nutch-0.9-dev  Unknown Yahoo robot  Info
+SitiDi.net/SitiDiBot/1.0 (+Have Good Day)  SitiDi.net search (Germany) robot  Info
-DIE-KRAEHE- META-SEARCH-ENGINE/1.1 http://www.die-kraehe.de  Die Kraehe Meta-Search-Engine (Germany) link checking  Info
123spider-Bot (Version: 1.02, powered by www.123spider.de  123spider.de (Germany) web directory link checking  Info
192.comAgent  192.com - UK web directory  Info
1st ZipCommander (Net) - http://www.zipcommander.com/  1st ZipCommander Net - IE based browser  Info
2Bone_LinkChecker/1.0 libwww-perl/5.64  2Bone online link checker  Info
4anything.com LinkChecker v2.0  4Anything robot  Info
8484 Boston Project v 1.0  Unknown guestbook spamming or harvesting tool from diff. IPs  Info
:robot/1.0 (linux) ( admin e-mail: undefined http://www.neofonie.de/loesungen/search/robot.html )  neofonie search robot Germany  Info
A-Online Search  A-Online.at robot - now Jet2Web Search  Info
A1 Keyword Research/1.0.2 (+http://www.micro-sys.dk/products/keyword-research/) miggibot/2007.03.27  A1 Keyword Research - search engine and keyword optimization software  Info
A1 Sitemap Generator/1.0 (+http://www.micro-sys.dk/products/sitemap-generator/) miggibot/2006.01.24  MiggiBot website crawler engine - A1 Sitemap Generator  Info
aardvark-crawler  Aardvark web crawler for Sun's Blog recommendations  Info
AbachoBOT  Abacho / Crawler.de robot  Info
AbachoBOT (Mozilla compatible)  Abacho / Crawler.de robot  Info
ABCdatos BotLink/5.xx.xxx#BBL  ABCdatos - Castilian program & tutorial directory  Info
Aberja Checkomat  Aberja Hybridsuchmaschine (Germany) link checking  Info
abot/0.1 (abot; http://www.abot.com; abot@abot.com)  Nameprotect copyright search robot (24.177.134.x)  Info
About/0.1libwww-perl/5.47  About robot  Info
Accelatech RSSCrawler/0.4  Accela Technology RSS feed crawler  Info
accoona  Accoona Search robot  Info
Accoona-AI-Agent/1.1.1 (crawler at accoona dot com)  Accoona Search robot  Info
Accoona-AI-Agent/1.1.2 (aicrawler at accoonabot dot com)  Accoona Search robot  Info
Ace Explorer  Ace Explorer - IE based browser  Info
Ack (http://www.ackerm.com/)  Ackerm search robot  Info
AcoiRobot  Acoi picture finder robot  Info
Acoon Robot v1.50.001  Acoon.de search (Germany) robot  Info
Acoon Robot v1.52 (http://www.acoon.de)  Acoon.de search (Germany) robot  Info
Acoon-Robot 4.0.x.[xx] (http://www.acoon.de)  Acoon.de search (Germany) robot  Info
Acoon-Robot v3.xx (http://www.acoon.de and http://www.acoon.com)  Acoon.de search (Germany) robot  Info
Acorn/Nutch-0.9 (Non-Profit Search Engine; acorn.isara.org; acorn at isara dot org)  Acorn Search Project  Info
ActiveBookmark 1.x  LibMaster.com Active Bookmark HTML page creator  C B  Info
Activeworlds  Activeworlds 3D homepage browser  Info
ActiveWorlds/3.xx (xxx)  Activeworlds 3D homepage browser  Info
Ad Muncher v4.xx.x  Ad Muncher - banner killer  Info
Ad Muncher v4x Build xxxxx  Ad Muncher - banner killer  Info
Adaxas Spider (http://www.adaxas.net/)  website directory adaxas link checking  Info
Advanced Browser (http://www.avantbrowser.com)  Avant Browser - IE based browser  Info
AESOP_com_SpiderMan  Aesop robot  Info
agadine/1.x.x (+http://www.agada.de)  Agada search (Germany) robot  Info
Agent-SharewarePlazaFileCheckBot/2.0+(+http://www.SharewarePlaza.com)  SharewarePlaza link checking  Info
AgentName/0.1 libwww-perl/5.48  Linkomatic submission verifier  Info
AIBOT/2.1 By +(www.21seek.com A Real artificial intelligence search engine China)  21seek.com (China) robot (218.17.90.xxx)  Info
AideRSS/1.0 (aiderss.com)  AideRss - Postrank RSS and Blog filtering  Info
aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com)  Nameprotect copyright search robot (24.177.134.x)  Info
aipbot/2-beta (aipbot dev; http://aipbot.com; aipbot@aipbot.com)  Nameprotect copyright search robot (24.177.134.x)  Info
Akregator/1.2.9; librss/remnants  Akregator news feed reader for KDE  Info
Aladin/3.324  Aladin robot  Info
Alcatel-BG3/1.0 UP.Browser/5.0.3.1.2  Phone.com UP.Browser for mobiles on Alcatel cellphone  Info
Aleksika Spider/1.0 (+http://www.aleksika.com/)  Aleksika Danmark - Search engine optimization spider  Info
AlertInfo 2.0 (Powered by Newsbrain)  Alertinfo - French version of Feedreader 3.xx   Info
AlkalineBOT/1.3  Vestris robot  Info
AlkalineBOT/1.4 (1.4.0326.0 RTM)  Vestris robot  Info
Allesklar/0.1 libwww-perl/5.46  Allesklar.de robot  Info
Alligator 1.31 (www.nearsoftware.com)  Alligator download manager  Info
Allrati/1.1 (+)  Unknown robot from Allrati.com  Info
AltaVista Intranet V2.0 AVS EVAL search@freeit.com  Altavista robot  Info
AltaVista Intranet V2.0 Compaq Altavista Eval sveand@altavista.net  Altavista robot  Info
AltaVista Intranet V2.0 evreka.com crawler@evreka.com  Altavista robot  Info
AltaVista V2.0B crawler@evreka.com  Altavista robot  Info
amaya/x.xx libwww/x.x.x  Amaya - W3C's Editor/Browser  Info
AmfibiBOT  Amfibi Search robot  Info
Amfibibot/0.06 (Amfibi Web Search; http://www.amfibi.com; agent@amfibi.com)  Amfibi Search robot  Info
Amfibibot/0.07 (Amfibi Robot; http://www.amfibi.com; agent@amfibi.com)  Amfibi Search robot  Info
amibot  amibot - Amidalla search engine robot (62.241.33.xx)  Info
Amiga-AWeb/3.4.167SE  AWeb Amiga browser  Info
AmigaVoyager/3.4.4 (MorphOS/PPC native)  Voyager - Amiga browser  Info
AmiTCP Miami (AmigaOS 2.04)  Amiga Miami TCP Stack    Info
Amoi 8512/R21.0 NF-Browser/3.3  NF embedded browser on Amois Skypephone  Info
amzn_assoc  Amazon.com robot for checking their affiliate sites  Info
AnnoMille spider 0.1 alpha - http://www.annomille.it  Annomille Italian historical oriented robot  Info
annotate_google; http://ponderer.org/download/annotate_google.user.js  annotate Google - Firefox extension for annotating Google search results  Info
Anonymized by ProxyOS: http://www.megaproxy.com  Megaproxy user  Info
Anonymizer/1.1  faked user agent    Info
AnswerBus (http://www.answerbus.com/)  AnswerBus natural language search using COLLATE technology  Info
AnswerChase PROve x.0  AnswerChase search tool    Info
AnswerChase x.0  AnswerChase search tool    Info
ANTFresco/x.xx  ANT Fresco Browser  Info
antibot-V1.1.5/i586-linux-2.2  Antibot (discontinued) robot  Info
AnzwersCrawl/2.0 (anzwerscrawl@anzwers.com.au;Engine)  Anzwers (Yahoo) Australia robot  Info
Apexoo Spider 1.x  Apexoo Search spider  Info
Aplix HTTP/1.0.1  JavaOS app. for SEGA Saturn Internet and Sanyo Internet-TV  Info
Aplix_SANYO_browser/1.x (Japanese)  JavaOS app. for Sanyo Internet-TV  Info
Aplix_SEGASATURN_browser/1.x (Japanese)  JavaOS app. for SEGA Saturn Internet  Info
Aport  Aport robot  Info
appie 1.1 (www.walhello.com)  Walhello Internet Search robot  Info
Apple iPhone v1.1.4 CoreMedia v1.0.0.4A102  CoreMedia player on Apple iPhone  Info
Apple-PubSub/65.1.1  PubSub - Mac OS X utility for managing RSS/Atom subscriptions via the PubSub framework  Info
ArabyBot (compatible; Mozilla/5.0; GoogleBot; FAST Crawler 6.4; http://www.araby.com;)  Araby search - Arabia  Info
ArachBot  Covac Arachnid Web Crawler  Info
Arachnoidea (arachnoidea@euroseek.com)  Euroseek spider  Info
aranhabot  Amazon.com robot for checking their affiliate sites  Info
ArchitextSpider  Excite spider  Info
archive.org_bot  Heritrix - The Internet Archive's open-source crawler (207.241.225.2xx)  Info
Argus/1.1 (Nutch; http://www.simpy.com/bot.html; feedback at simpy dot com)  Simpy Bookmarklet crawler (69.55.233.xx)  Info
Arikus_Spider  Arikus inContext search engine software  Info
Arquivo-web-crawler (compatible; heritrix/1.12.1 +http://arquivo-web.fccn.pt)  Tomba project: the Portuguese web archive  Info
ASAHA Search Engine Turkey V.001 (http://www.asaha.com/)  Asaha search robot (Turkey)  Info
Asahina-Antenna/1.x  ASAHINA Antenna information detecting agent  Info
Asahina-Antenna/1.x (libhina.pl/x.x ; libtime.pl/x.x)  ASAHINA Antenna information detecting agent  Info
ask.24x.info  Ask 24x Info robot  Info
AskAboutOil/0.06-rcp (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@askaboutoil.com)  Ask About Oil - Petroleum related search (24.227.212.xxx) using Nutch  Info
asked/Nutch-0.8 (web crawler; http://asked.jp; epicurus at gmail dot com)  askEd! / Inferret search (Japan) robot using Nutch  Info
ASPSeek/1.2.5  ASPSeek search engine software -Yahoo-Inc. / Telecom Canada robot   Info
ASPseek/1.2.9d  Swsoft.net robot using Aspseek  Info
ASPSeek/1.2.x  ASPSeek search engine software  Info
ASPSeek/1.2.xa  ASPSeek search engine software  Info
ASPseek/1.2.xx  ASPSeek search engine software  Info
ASPSeek/1.2.xxpre  ASPSeek search engine software  Info
ASSORT/0.10  Associative Sort robot  Info
asterias/2.0  Singingfish media spider (64.12.186.2xx) via AOL search  Info
AtlocalBot/1.1 +(http://www.atlocal.com/local-web-site-owner.html)  Atlocal local business search robot  Info
Atomic_Email_Hunter/4.0  Atomic Email Hunter email extracing and harvesting  Info
Atomz/1.0  Atomz robot  Info
atSpider/1.0  atSpider (ceased) email harvester / spambot  Info
Attentio/Nutch-0.9-dev (Attentio's beta blog crawler; www.attentio.com; info@attentio.com)  Attentio social media monitoring and analysing   Info
AU-MIC/2.0 MMP/2.0  Samsung SPH-A660 phone with Sprint software  Info
AUDIOVOX-SMT5600  Audiovox SMT5600 (AT&T) Smartphone mobile phone browser  Info
augurfind  Augurnet Swiss (was www.augurnet.ch) search robot  Info
augurnfind V-1.x  Augurnet Swiss (was www.augurnet.ch) search robot  Info
autoemailspider  Auto Email Pro Email harvester  Info
autohttp  Linkscan tool from Elsop  Info
autowebdir 1.1 (www.autowebdir.com)  Autowebdir - The Automatically Generated Web Directory  Info
AV Fetch 1.0  Altavista robot ??  Info
Avant Browser (http://www.avantbrowser.com)  Avant Browser - IE based browser  Info
AVSearch-1.0(peter.turney@nrc.ca)  National Research Council Canada robot  Info
AVSearch-2.0-fusionIdx-14-CompetitorWebSites  Unknown robot from 205.203.108.xx (telerate.com)    Info
AVSearch-3.0(AltaVista/AVC)  Altavista robot  Info
AWeb  AWeb Amiga browser  Info
axadine/ (Axadine Crawler; http://www.axada.de/; )  Axada search Germany robot  Info
AxmoRobot - Crawling your site for better indexing on www.axmo.com search engine.  Axmo search robot  Info
Azureus 2.x.x.x  Azureus Java BitTorrent Client  Info
BabalooSpider/1.3 (BabalooSpider; http://www.babaloo.si; spider@babaloo.si)  Babaloo search robot (Slovenia)  Info
BaboomBot/1.x.x (+http://www.baboom.us)  BaBoom Web Portal (ODP) robot (66.98.254.xx)  Info
BackStreet Browser 3.x  BackStreet Browser - Offline browser / website downloader  Info
BaiduImagespider+(+http://www.baidu.jp/search/s308.html)  Baidu search (Japan) image crawler  Info
BaiDuSpider  Baidu spidering engine - used by diff. IPs  Info
Baiduspider+(+http://help.baidu.jp/system/05.html)  Baidu spidering engine - used by diff. IPs  Info
Baiduspider+(+http://www.baidu.com/search/spider.htm)  Baidu spidering engine - used by diff. IPs  Info
Baiduspider+(+http://www.baidu.com/search/spider_jp.html)  Baidu search (Japan) crawler  Info
Balihoo/Nutch-1.0-dev (Crawler for Balihoo.com search engine - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com)  Balihoo - Vertical search engine crawler (beta)  Info
BanBots/1.2 (spider@banbots.com)  Project BanBots Perl script robot  Info
Barca/2.0.xxxx  Barca Pro email & PIM software  Info
BarcaPro/1.4.xxxx  Barca Pro email & PIM software  Info
BarraHomeCrawler (albertof@barrahome.org)  Barrahome crawler  Info
bCentral Billing Post-Process  Unknown user agent from Microsoft    Info
bdcindexer_2.6.2 (research@bdc)  Business.com robot  Info
BDFetch  Brandimensions Brand Protection robot  Info
BDNcentral Crawler v2.3 [en] (http://www.bdncentral.com/robot.html) (X11; I; Linux 2.0.44 i686)  Bdncentral Sitesearch robot  Info
BeamMachine/0.5 (dead link remover of www.beammachine.net)  beammachine web directory (Germany) link checking  R C  Info
beautybot/1.0 (+http://www.uchoose.de/crawler/beautybot/)  Beauty robot for Cosmoty - German beauty and wellness search  Info
BebopBot/2.5.1 ( crawler http://www.apassion4jazz.net/bebopbot.html )  A Passion for Jazz music related search robot  Info
BeebwareDirectory/v0.01  LinkcheckerBeepware (site is down) web directory link checking  Info
Big Brother (http://pauillac.inria.fr/~fpottier/)  Big Brother link checking tool  Info
Big Fish v1.0  GoonGee.com link popularity checking  Info
BigBrother/1.6e  BB4 network monitoring  Info
BigCliqueBOT/1.03-dev (bigclicbot; http://www.bigclique.com; bot@bigclique.com)  BigClique Search robot  Info
BIGLOTRON (Beta 2;GNU/Linux)  Biglotron search (France) robot  Info
Bigsearch.ca/Nutch-x.x-dev (Bigsearch.ca Internet Spider; http://www.bigsearch.ca/; info@enhancededge.com)  Bigsearch.ca search robot  Info
Bilbo/2.3b-UNIX  Bilbo - web frontend for the Nessus Security Scanner  Info
BilgiBetaBot/0.8-dev (bilgi.com (Beta) ; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)  Bilgi.com (Beta) search robot - Turkey  Info
BilgiBot/1.0(beta) (http://www.bilgi.com/; bilgi at bilgi dot com)  Bilgi.com (Beta) search robot - Turkey  Info
billbot wjj@cs.cmu.edu  Carnegie Mellon School robot/link checking ?  Info
Bitacle bot/1.1  Bitacle Blog Search Archive robot  Info
Bitacle Robot (V:1.0;) (http://www.bitacle.com)  Bitacle Blog Search Archive robot  Info
Biyubi/x.x (Sistema Fenix; G11; Familia Toledo; es-mx)  Biyubi Navigator - Mexican browser for Fenix OS  Info
BlackBerry7520/4.0.0 Profile/MIDP-2.0 Configuration/CLDC-1.1 UP.Browser/5.0.3.3 UP.Link/5.1.2.12 (Google WAP Proxy/1.0)  Blackberry Wireless Internet browser via Google WAP Proxy  B P  Info
BlackWidow  FS Consulting (was www.fsconsult.net) Black Widow web crawler  Info
BlackWidow  BlackWidow web site scanner / downloading tool  Info
Blaiz-Bee/1.0 (+http://www.blaiz.net)  Blaiz Enterprises RawGrunt search  Info
Blaiz-Bee/2.00.8222 (BE Internet Search Engine http://www.rawgrunt.com)  Blaiz Enterprises RawGrunt search  Info
Blaiz-Bee/2.00.xxxx (+http://www.blaiz.net)  Blaiz Enterprises RawGrunt search  Info
BlitzBOT@tricus.net  Blitzsuche Germany robot  Info
BlitzBOT@tricus.net (Mozilla compatible)  Blitzsuche Germany robot  Info
BlockNote.Net  BlockNote web page editor  Info
BlogBot/1.x  blogdex robot from MIT.edu  Info
BlogBridge 2.13 (http://www.blogbridge.com/)  BlogBridge RSS reader  Info
Bloglines Title Fetch/1.0 (http://www.bloglines.com)  Bloglines article search  Info
Bloglines-Images/0.1 (http://www.bloglines.com)  Bloglines graphics crawler  Info
Bloglines/3.1 (http://www.bloglines.com)  Bloglines news crawler  Info
BlogMap (http://www.feedmap.net)  FeedMap / BlogMap geo coding service  Info
Blogpulse (info@blogpulse.com)  Intelliseek's BlogPulse blog search  Info
BlogPulseLive (support@blogpulse.com)  Intelliseek's BlogPulse blog search  Info
BlogSearch/1.x +http://www.icerocket.com/  IceRocket Web search robot  Info
blogsearchbot-pumpkin-3  Art of Computing blog search project  Info
BlogsNowBot, V 2.01 (+http://www.blogsnow.com/)  BlogsNow realtime link tracker robot  Info
BlogVibeBot-v1.1 (spider@blogvibe.nl)  BlogVipe news and Blog crawler (Netherlands)  Info
blogWatcher_Spider/0.1 (http://www.lr.pi.titech.ac.jp/blogWatcher/)  blogWatcher robot from Okumura Group Tokyo (131.112.182.xxx)  Info
BlogzIce/1.0 (+http://icerocket.com; rhodes@icerocket.com)  IceRocket Web search robot  Info
BlogzIce/1.0 +http://www.icerocket.com/  IceRocket Web search robot  Info
BloobyBot  Blooby search (beta) robot  Info
Bloodhound/Nutch-0.9 (Testing Crawler for Research - obeys robots.txt and robots meta tags ; http://balihoo.com/index.aspx; robot at balihoo dot com)  Balihoo - Search Engine for Advertising Media  Info
bluefish 0.6 HTML editor  Bluefish HTML-editor for Linux  Info
BMCLIENT  Part of ButtMan remote access tool    Info
BMLAUNCHER  Bookmark Express bookmark manager  Info
Bobby/4.0.x RPT-HTTPClient/0.3-3E  Bobby web accessibility desktop testing tool  Info
boitho.com-dc/0.xx (http://www.boitho.com/dcbot.html)  Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx  Info
boitho.com-robot/1.x  Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx  Info
boitho.com-robot/1.x (http://www.boitho.com/bot.html)  Boitho search (Norway) robot via 80.202.212.xx / 80.80.111.xx  Info
Bookdog/x.x  Bookdog - Mac bookmark manager  Info
Bookmark Buddy bookmark checker (http://www.bookmarkbuddy.net/)  Bookmark Buddy - favorite bookmark manager   Info
Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/]  Favourites managing program  Info
Bookmark Renewal Check Agent [http://www.bookmark.ne.jp/] (Version 2.0beta)  Favourites managing program  Info
BookmarkBase(2/;http://bookmarkbase.com)  Bookmark Base bookmark manager  Info
Bot mailto:craftbot@yahoo.com  cybercity.fr user robot / faked user agent ?    Info
BPImageWalker/2.0 (www.bdbrandprotect.com)  BD-Brandprotect copyright infringement crawler  Info
BravoBrian bstop.bravobrian.it  BravoBrian bSTOP parental control  P R  Info
BravoBrian SpiderEngine MarcoPolo  Robot for BravoBrian bSTOP  Info
BrightCrawler (http://www.brightcloud.com/brightcrawler.asp)  BrightCloud web filtering for classifying websites  P R  Info
BruinBot (+http://webarchive.cs.ucla.edu/bruinbot.html)   Webarchive Project Bruinbot crawler  Info
BSDSeek/1.0  Inktomi (Hotbot-Lycos NBCi) robot  Info
BStop.BravoBrian.it Agent Detector  BravoBrian bSTOP parental control  P R  Info
BTbot/0.x (+http://www.btbot.com/btbot.html)  BitTorrent Search Engine btbot robot  Info
BTWebClient/180B(9704)  µTorrent BitTorrent Client  Info
BuildCMS crawler (http://www.buildcms.com/crawler)  BuildCMS crawler - market monitoring project of BuildCMS  Info
Bulkfeeds/r1752 (http://bulkfeeds.net/)  Bulkfeeds: RSS directory link checking  Info
BullsEye  BullsEye/Intelliseek robot  Info
bumblebee@relevare.com  Relevare Portal software robot  Info
BunnySlippers  Microsoft server information robot (see link)  Info
BurstFindCrawler/1.1 (crawler.burstfind.com; http://crawler.burstfind.com; crawler@burstfind.com)  BurstFind search crawler (64.34.172.xx)  Info
Buscaplus Robi/1.0 (http://www.buscaplus.com/robi/)  Buscaplus (Spain) robot  Info
BW-C-2.0  Logitech Desktop Managers (LDM) Backweb (BW) update check  Info
bwh3_user_agent  Basic Web Hacking 3 fake user-agent from Hellbound Hackers challenges  Info
Cabot/Nutch-0.9 (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com)  Amfibi Search robot  Info
Cabot/Nutch-1.0-dev (Amfibi's web-crawling robot; http://www.amfibi.com/cabot/; agent@amfibi.com)  Amfibi Search robot  Info
CamelHttpStream/1.0  Evolution integrated mail solution Camel TCP stream class    Info
Cancer Information and Support International;  Some user agent    Info
carleson/1.0  Cosmix project crawler (204.14.48.x / 38.113.234.xxx)  Info
Carnegie_Mellon_University_Research_WebBOT-->PLEASE READ-->http://www.andrew.cmu.edu/~brgordon/webbot/index.html http://www.andrew.cmu.edu/~brgordon/webbot/index.html  Carnegie Mellon University WebBOT  Info
Carnegie_Mellon_University_WebCrawler http://www.andrew.cmu.edu/~brgordon/webbot/index.html  Carnegie Mellon University WebBOT  Info
Catall Spider  Catall.de search & web directory (Germany)  Info
CazoodleBot/CazoodleBot-0.1 (CazoodleBot Crawler; http://www.cazoodle.com/cazoodlebot; cazoodlebot@cazoodle.com)  UIUCs Cazoodle search based on MetaQuerier  Info
CCBot/1.0 (+http://www.commoncrawl.org/bot.html)  CommonCrawl Foundation search crawler  Info
ccubee/x.x  Empyreum Ccubee (Czech) search engine solution  Info
CDR/1.7.1 Simulator/0.7(+http://timewe.net) Profile/MIDP-1.0 Configuration/CLDC-1.0  Timewe mobile browser (WAP) simulator (Japan)  Info
CE-Preload  Cisco Content Engine  Info
CentiverseBot  Nordic semantic search engine  Info
CentiverseBot - investigator  Nordic semantic search engine  Info
CentiverseBot/3.0 (http://www.centiverse-project.net)  Nordic semantic search engine  Info
Ceramic Tile Installation Guide (http://www.floorstransformed.com)  Floortransformed.com robot (link ckecking ??)  Info
CERN-LineMode/2.15  CERN Line Mode Browser  Info
cfetch/1.0  Cosmix project crawler (204.14.48.x / 38.113.234.xxx)  Info
CFNetwork/x.x  MaxOS X CoreFoundation CFNetwork API    Info
cg-eye interactive  cg-eye CGI checker  Info
Charon/1.x (Amiga)  Charon Amiga download manager  Info
Chat Catcher/1.0  Chat Catcher blog monitoring robot  Info
Checkbot/1.xx LWP/5.xx  Checkbot link validation  Info
CheckLinks/1.x.x  Checklinks - Perl link checker  Info
CheckUrl  NTL user agent    Info
CheckWeb  CheckWeb link validation  Info
Chilkat/1.0.0 (+http://www.chilkatsoft.com/ChilkatHttpUA.asp)  Chilkat HTTP component user-agent    Info
China Local Browse 2.6  Unknown spam bot from telekom.com.my (218.111.83.xxx)  Info
Chitika ContentHit 1.0  Chitika Inc. Blog advertising  Info
ChristCRAWLER 2.0  Christcentral.com Christcrawler (was www.christcrawler.com)  Info
CHttpClient by Open Text Corporation  CHttpClient - C++ class using WinInet    Info
CipinetBot (http://www.cipinet.com/bot.html)  CipinetBot -Cipinet Search Engine Web Crawler  Info
Cityreview Robot (+http://www.cityreview.org/crawler/)  Cityreview regional search (Germany) link checking  Info
CJ Spider/  Commision Junction link checking spider  Info
CJB.NET Proxy  CJB Net anonymous socks proxy service (216.194.70.x)  Info
ClariaBot/1.0  Claria (ex Gator) SearchScout robot (64.152.73.xx)  Info
Claymont.com  Claymont Search robot  Info
CloakDetect/0.9 (+http://fulltext.seznam.cz/)  Seznam Search (Czech Republic) robot  Info
Clushbot/2.x (+http://www.clush.com/bot.html)  Clush clustered search robot  Info
Clushbot/3.x-BinaryFury (+http://www.clush.com/bot.html)  Clush clustered search robot  Info
Clushbot/3.xx-Ajax (+http://www.clush.com/bot.html)  Clush clustered search robot  Info
Clushbot/3.xx-Hector (+http://www.clush.com/bot.html)  Clush clustered search robot  Info
Clushbot/3.xx-Peleus (+http://www.clush.com/bot.html)  Clush clustered search robot  Info
COAST WebMaster Pro/4.x.x.xx (Windows NT)  COAST Webmaster - Web management and maintenance software  Info
CoBITSProbe  Proposed Content-Based Image Tracking System (CoBITS) P2P crawler  R C  Info
Cocoal.icio.us/1.0 (v36) (Mac OS X; http://www.scifihifi.com/cocoalicious)  Cocoa del.icio.us (social bookmarks manager) client for Mac OS X  Info
Cogentbot/1.X (+http://www.cogentsoftwaresolutions.com/bot.html)  Cogent Search Bot from Cogent Software Solutions for unknown purposes  Info
ColdFusion  Cold Fusion server used by various IPs i.e.: - NetWORLD web catalogue link checking  P C  Info
ColdFusion (BookmarkTracker.com)  Cold Fusion server used by Bookmark Tracker - online favourites managment  Info
collage.cgi/1.xx  WebCollage Syndicator graphics crawler/collector  R D  Info
combine/0.0  Combine harvesting & indexing robot  Info
Combine/2.0 http://combine.it.lth.se/  Combine harvesting & indexing robot  Info
Combine/3 http://combine.it.lth.se/  Combine harvesting & indexing robot  Info
Combine/x.0  Combine harvesting & indexing robot  Info
cometrics-bot, http://www.cometrics.de  cometrics Web Content Mining solution - Germany  Info
Commerce Browser Center  Wildsoft Germany (closed) Internet client system user-agent (was www.oskarweb.de)  Info
complex_network_group/Nutch-0.9-dev (discovering the structure of the world-wide-web; http://cantor.ee.ucla.edu/~networks/crawl; nimakhaj@gmail.com)  UCLA Complex Networks Groups Complex Network Analysis  Info
Computer_and_Automation_Research_Institute_Crawler crawler@ilab.sztaki.hu  Hungarian Academy of Sciences data mining search  Info
Comrite/0.7.1 (Nutch; http://lucene.apache.org/nutch/bot.html; nutch-agent@lucene.apache.org)  ComRite Chinese Search Engine for Oversea Web Sites (69.248.26.xx)  Info
Contact  unknown    Info
ContactBot/0.2  Probably E-Mail harvesting robot - same as LMQueueBot  Info
ContentSmartz  ContentSmartz e-mail harvesting tools  Info
contype  Internet Explorer versions 4.x and 5 plugin content  Info
Convera Internet Spider V6.x  Converas RetrievalWare Internet Spider (63.241.61.x)  Info
ConveraCrawler/0.2  Converas RetrievalWare Internet Spider (63.241.61.x)  Info
ConveraCrawler/0.9d (+http://www.authoritativeweb.com/crawl)  Converas RetrievalWare Internet Spider (63.241.61.x)  Info
ConveraMultiMediaCrawler/0.1 (+http://www.authoritativeweb.com/crawl)  Converas RetrievalWare Internet Spider (63.241.61.x)  Info
CoolBot  Suchmaschine21 (Germany) robot  Info
Cooliris/1.5 CFNetwork/459 Darwin/10.0.0d3  Cooliris photo and video browser  Info
CoralWebPrx/0.1.1x (See http://coralcdn.org/)  Coral Content Distribution Network  P C  Info
cosmos/0.8_(robot@xyleme.com)  Xyleme SA France robot  Info
cosmos/0.9_(robot@xyleme.com)  Xyleme SA France robot  Info
CoteoNutchCrawler/Nutch-0.9 (info [at] coteo [dot] com)  Coteo.com - local French directory link checking  Info
CougarSearch/0.x (+http://www.cougarsearch.com/faq.shtml)  Cougarsearch.com robot  Info
Covac TexAs Arachbot  Covac Arachnid Web Crawler  Info
CoverScout%203/3.0.1 CFNetwork/339.5 Darwin/9.5.0 (i386) (iMac5,1)  CoverScout for iTunes - CD cover search tool  Info
Cowbot-0.1 (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)  Naver Japan / Korea robot  Info
Cowbot-0.1.x (NHN Corp. / +82-2-3011-1954 / nhnbot@naver.com)  Naver Japan / Korea robot  Info
CrawlConvera0.1 (CrawlConvera@yahoo.com)  Converas RetrievalWare Internet Spider  Info
Crawler  unknown robot via Level3.net    Info
Crawler (cometsearch@cometsystems.com)  Cometsystems Comet Search robot via Findwhat (now Miva)  Info
Crawler admin@crawler.de  Crawler.de / Abacho robot  Info
Crawler V 0.2.x admin@crawler.de  Crawler.de / Abacho robot  Info
crawler@alexa.com  Alexa crawler  Info
CrawlerBoy Pinpoint.com  Pinpoint WAP search robot  Info
Crawllybot/0.1 (Crawllybot; +http://www.crawlly.com; crawler@crawlly.com)  Crawlly Beta search - Germany (72.232.194.2xx)  Info
CreativeCommons/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net)  Creatice Commons using Nutch open source robot  Info
Cricket-A100/1.0 UP.Browser/6.3.0.7 (GUI) MMP/2.0  Cricket A100 cell phone browser  Info
CrocCrawler vx.3 [en] (http://www.croccrawler.com) (X11; I; Linux 2.0.44 i686)  Croccrawler robot  Info
csci_b659/0.13  Web mining project from CSCI 659 (computer science course) at Indiana Univerity  Info
CSE HTML Validator Professional (http://www.htmlvalidator.com/)  CSE HTML Validator for Windows  Info
Cuam Ver0.050bx  Cuam - IE based browser  Info
Cuasarbot/0.9b http://www.cuasar.com/spider_beta/   Cuasar (Spain) music / ringtone search spider  Info
curl/7.10.x (i386-redhat-linux-gnu) libcurl/7.10.x OpenSSL/0.9.7a ipv6 zlib/1.1.4  Curl file transferring tool  Info
curl/7.7.x (i386--freebsd4.3) libcurl 7.7.x (SSL 0.9.6) (ipv6 enabled)  Curl file transferring tool  Info
curl/7.8 (i686-pc-linux-gnu) libcurl 7.8 (OpenSSL 0.9.6)  Curl file transferring tool  Info
curl/7.9.x (win32) libcurl 7.9.x  Curl file transferring tool  Info
CurryGuide SiteScan 1.1  CurryGuide UK link check robot  Info
Custo x.x (www.netwu.com)  Custo web site spidering tool (link checking)  Info
Custom Spider www.bisnisseek.com /1.0  Bisnisseek (was www.bisnisseek.com) robot  Info
Cyberdog/2.0 (Macintosh; 68k)  Cyberdog Mac Browser (was www.cyberdog.org)  Info
CyberPatrol SiteCat Webbot (http://www.cyberpatrol.com/cyberpatrolcrawler.asp)  CyberPatrol LLC robot for web filtering software  Info
CyberSpyder Link Test/2.1.12 (admin@mspennyworth.com)  CyberSpyder Link Test software  Info
CydralSpider/1.x (Cydral Web Image Search; http://www.cydral.com)  Cydral image & site search spider  Info
CydralSpider/3.0 (Cydral Image Search; http://www.cydral.com)  Cydral image & site search spider  Info
DA 3.5 (www.lidan.com)  Downloadaccelerator download manager  Info
DA 4.0  Downloadaccelerator download manager  Info
DA 4.0 (www.downloadaccelerator.com)  Downloadaccelerator download manager  Info
DA 5.0  Downloadaccelerator download manager  Info
DA 7.0  Downloadaccelerator download manager  Info
DAP x.x  Download Accelerator Plus download manager  Info
Dart Communications PowerTCP  PowerTCP ActiveX control tool    Info
DataCha0s/2.0  Unknown bot from Kornet Korea (218.149.129.xxx) scans for Perl Awstats  Info
DataCha0s/2.0  Unknown UA looking for Awstats Perl components  Info
DataFountains/DMOZ Downloader  INFOMINE/iVia Scholary Internet Resource Collections robot  Info
DataFountains/Dmoz Downloader (http://ivia.ucr.edu/useragents.shtml)  INFOMINE/iVia Scholary Internet Resource Collections robot  Info
DataFountains/DMOZ Feature Vector Corpus Creator (http://ivia.ucr.edu/useragents.shtml)  INFOMINE/iVia Scholary Internet Resource Collections robot  Info
DataparkSearch/4.47 (+http://dataparksearch.org/bot)  DataparkSearch open source search engine  Info
DataparkSearch/4.xx (http://www.dataparksearch.org/)  DataparkSearch open source search engine  Info
DataSpear/1.0 (Spider; http://www.dataspear.com/spider.html; spider@dataspear.com)  DataSpear Directory robot (24.109.29.xx)  Info
DataSpearSpiderBot/0.2 (DataSpear Spider Bot; http://dssb.dataspear.com/bot.html; dssb@dataspear.com)  DataSpear Directory robot (24.109.29.xx)  Info
DatenBot( http://www.sicher-durchs-netz.de/bot.html)  Sicher-durchs-Netz German security related search (62.75.220.xxx)  Info
DaviesBot/1.7 (www.wholeweb.net)  Wholeweb robot  Info
daypopbot/0.x  Daypop blog - weblog - online mag search spider  Info
dbDig(http://www.prairielandconsulting.com)  dbDig search engine  Info
DBrowse 1.4b  Some site scanning tool via diff. IPs i.e.: - wanweb.net (208.6.163.xxx) - cox.net (68.4.xxx.xxx)  Info
DBrowse 1.4d  Some site scanning tool via diff. IPs i.e.: - pacbell.net (67.112.xxx.xxx)  Info
DC-Sakura/x.xx  DC-Sakura download manager  Info
dCSbot/1.1  unknown divine/Openmarket.com robot  Info
DDD  some (website) downloading tool  Info
dds explorer v1.0 beta  Unknown user agent    Info
de.searchengine.comBot 1.2 (http://de.searchengine.com/spider)  Searchengine.com (Germany) submission checking / robot (84.73.57.xx)  Info
DeadLinkCheck/0.4.0 libwww-perl/5.xx  DLC Perl HTTP link checking  Info
Deep Link Calculator v1.0  Sootle Web Directory deep link checker  Info
deepak-USC/ISI  deepak-USC/ISI robot from USC/Information Science Institute  Info
DeepIndex  Deepindex robot  Info
DeepIndex ( http://www.zetbot.com )  Zetbot search Belgium (213.41.128.xx) using Deepindex robot  Info
DeepIndex (www.en.deepindex.com)  Deepindex robot  Info
DeepIndexer.ca  Deepindex robot (via Paragon.net Canada)  Info
del.icio.us-thumbnails/1.0 Mozilla/5.0 (compatible; Konqueror/3.4; FreeBSD) KHTML/3.4.2 (like Gecko)  del.icio.us picture robot for thumbnail preview via Yahoo  Info
DeleGate/9.0.5-fix1  DeleGate application level gateway / proxy server  Info
Demo Bot DOT 16b  Some site scanning tool from 217.34.59.xxx (btopenworld.com)  Info
Demo Bot Z 16b  Some site scanning tool from 68.154.96.xx (bellsouth.net)  Info
Denmex websearch (http://search.denmex.com)  Denmex Websearch robot/link checking  Info
Der große BilderSauger 2.00u  DataBecker Bilder Sauger (discontinued) web graphics downloader  Info
dev-spider2.searchpsider.com/1.3b  Searchspider.com robot (72.245.225.xxx)  Info
DevComponents.com HtmlDocument Object  DevComponents HTMLDocument Class Library for Visual Studio.net    Info
DiaGem/1.1 (http://www.skyrocket.gr.jp/diagem.html)  DiaGem Japan web crawler  Info
Diamond/x.0  Claria (ex Gator) SearchScout robot (64.152.73.xx)  Info
DiamondBot  Claria (ex Gator) SearchScout robot (64.152.73.xx)  Info
Digger/1.0 JDK/1.3.0rc3  Diggit! robot  Info
DigOut4U  OpenPortal4U robot  Info
DIIbot/1.2  Findsame.com (site is offline) / Digital-Integrity robot  Info
Dillo/0.8.5-i18n-misc  Dillo Web Browser  Info
Dillo/0.x.x  Dillo Web Browser  Info
disastrous/1.0.5 (running with Python 2.5.1; http://www.bortzmeyer.org/disastrous.html; archangel77@del.icio.us)  disastrous - a del.icio.us link checker based on Python  Info
DISCo Pump x.x  DISCo Pump offline browser / website ripper  Info
disco/Nutch-0.9 (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com)  Unkown robot from Discovery Engine Corp.  Info
disco/Nutch-1.0-dev (experimental crawler; www.discoveryengine.com; disco-crawl@discoveryengine.com)  Unkown robot from Discovery Engine Corp.  Info
DittoSpyder  Ditto picture search robot  Info
dlman  some download agent  Info
dloader(NaverRobot)/1.0  Naver Japan / Korea robot  Info
DNSRight.com WebBot Link Ckeck Tool. Report abuse to: dnsr@dnsright.com  DNS Right - Online DNS tools  Info
DoCoMo/1.0/Nxxxi/c10  NTT DoCoMo (Japan) robot  Info
DoCoMo/1.0/Nxxxi/c10/TB  NTT DoCoMo (Japan) robot  Info
DoCoMo/1.0/P502i/c10 (Google CHTML Proxy/1.0)  Google (216.239.39.x) proxy server  Info
DoCoMo/2.0 P900iV(c100;TB;W24H11)   NTT DoCoMo (Japan) robot  Info
DoCoMo/2.0 SH901iS(c100;TB;W24H12),gzip(gfe) (via translate.google.com)  NTT DoCoMo (Japan) proxy server (210.136.161.1xx)  Info
DoCoMo/2.0 SH902i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html)  Yahoo Search Japan robot (203.216.197.xxx)  Info
DoCoMo/2.0/SO502i (compatible; Y!J-SRD/1.0; http://help.yahoo.co.jp/help/jp/search/indexing/indexing-27.html)  Yahoo Search Japan robot (203.216.197.xxx)  Info
DocZilla/1.0 (Windows; U; WinNT4.0; en-US; rv:1.0.0) Gecko/20020804  DocZilla - Mozilla-based SGML/XML/HTML- browser  Info
dodgebot/experimental  unknown robot from AGMLAB Information Technologies (Information retrieval system ?)  Info
DonutP; Windows98SE  Donut P - Japanese IE based browser  Info
Doubanbot/1.0 (bot@douban.com http://www.douban.com)  Unknown robot from douban search (China) - maybe image crawling    Info
Download Demon/3.x.x.x  Download Demon/Netzip download manager  Info
Download Druid 2.x  Download Druid IE plugin download manager  Info
Download Express 1.0  Download Express download manager  Info
Download Master  Download Master download manager  Info
Download Ninja 3.0  Download Ninja download manager (Japan)  Info
Download Wonder  Download Wonder download manager  Info
Download-Tipp Linkcheck (http://download-tipp.de/)  Download-Tipp Germany link checking  Info
Download.exe(1.1) (+http://www.sql-und-xml.de/freeware-tools/)  download.exe .NET based downloading tool  Info
DownloadDirect.1.0  Download Direct download manager  Info
Dr.Web (R) online scanner: http://online.drweb.com/  Dr.WEB online virus scanner    Info
Dragonfly File Reader  Dragonfly CMS - Open Source content management system  Info
Drecombot/1.0 (http://career.drecom.jp/bot.html)  Drecom Japan (210.233.67.xxx) - Blog search ??  Info
Drupal (+http://drupal.org/)  Drupal - open source content management platform  Info
DSurf15a 01  Some site scanning tool via diff. IPs i.e.: - cox.net (68.5.xxx.xxx) - pacbell.net (64.16x.xxx.xxx)  Info
DSurf15a 71  Some site scanning tool via diff. IPs i.e.: - cox.net (68.4.xxx.xxx)  Info
DSurf15a 81  Some site scanning tool via diff. IPs i.e.: - verizon.net (4.47.xxx.xxx)  Info
DSurf15a VA  Some site scanning tool via diff. IPs i.e.: - eastlink.ca (24.222.xxx.xxx) - cogeco.net (216.221.8x.xxx)  Info
DTAAgent  DTAAgent Java object for data collecting  R D  Info
dtSearchSpider  dt Search Spider software  Info
Dual Proxy  Fourelle Venturi proxy server  Info
DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html)  Duck Duck Go search crawler  Info
Dumbot(version 0.1 beta - dumbfind.com)  DumbFind.com robot  Info
Dumbot(version 0.1 beta - http://www.dumbfind.com/dumbot.html)  DumbFind.com robot  Info
Dumbot(version 0.1 beta)  DumbFind.com robot  Info
e-sense 1.0 ea(www.vigiltech.com/esensedisclaim.html)  Vigiltech e-Sense user research robot (website is offline)  Info
e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/)  e-Society Project (Japan) crawler (133.9.238.xx)  Info
eApolloBot/2.0 (compatible; heritrix/2.0.0-SNAPSHOT-20071024.170148 +http://www.eapollo-opto.com)  Global Opto's eApollo Flash based search engine - Taiwan  Info
EARTHCOM.info/1.x [www.earthcom.info]  Earthcom (Czech Republic) search robot (194.108.39.xx)  Info
EARTHCOM.info/1.xbeta [www.earthcom.info]  Earthcom (Czech Republic) search robot (194.108.39.xx)  Info
EasyDL/3.xx  Keywen Encyclopedia Bot  Info
EasyDL/3.xx http://keywen.com/Encyclopedia/Bot  Keywen Encyclopedia Bot  Info
EBrowse 1.4b  Some site scanning tool via diff. IPs i.e.: - swbell.net (65.66.xxx.xxx)  Info
eCatch/3.0  eCatch (now Wysigot) offline browser  B D  Info
EchO!/2.0  Echo.fr robot  Info
Educate Search VxB  Some site scanning tool via diff. IPs i.e.: - cox.net (68.4.xxx.xxx)  Info
egothor/3.0a (+http://www.xdefine.org/robot.html)  Xdefine text search engine robot - based on Egothor open source crawler  Info
EgotoBot/4.8 (+http://www.egoto.com/about.htm)  Egoto Search robot  Info
ejupiter.com  eJupiter searcg robot (206.191.49.xx)  Info
EldoS TimelyWeb/3.x  TimelyWeb web page monitoring tool  Info
elfbot/1.0 (+http://www.uchoose.de/crawler/elfbot/)  Elftales crawler for uChoose theme based search (Germany)  Info
ELI/20070402:2.0 (DAUM RSS Robot, Daum Communications Corp.; +http://ws.daum.net/aboutkr.html)  DAUMOA - RSS search robot of Daum  Info
ELinks (0.x.x; Linux 2.4.20 i586; 132x60)  ELinks text mode browser  Info
ELinks/0.x.x (textmode; NetBSD 1.6.2 sparc; 132x43)  ELinks text mode browser  Info
EmailSiphon  Sonic E-mail collector  Info
EmailSpider  EmailSpider E-mail harvesting software  Info
EmailWolf 1.00  Trellian EMailWolf E-mail collector  Info
EmeraldShield.com WebBot  EmeraldShield spam and web filtration services  P R  Info
EmeraldShield.com WebBot (http://www.emeraldshield.com/webbot.aspx)  EmeraldShield spam and web filtration services  P R  Info
EMPAS_ROBOT  Empas search Korea robot (220.95.22x.xxx)  Info
EnaBot/1.x (http://www.enaball.com/crawler.html)  Enabot - Enaball semantic search project crawler  Info
endo/1.0 (Mac OS X; ppc i386; http://kula.jp/endo)  endo - Mac news site and blog aggregator  Info
Enfish Tracker  Enfish Personal search tool  Info
Enterprise_Search/1.0  Enterprise Search engine software (64.202.165.xxx)  Info
Enterprise_Search/1.0.xxx  Enterprise Search engine software (64.202.165.xxx)  Info
Enterprise_Search/1.00.xxx;MSSQL (http://www.innerprise.net/es-spider.asp)  Enterprise Search engine software (64.202.165.xxx)  Info
envolk/1.7 (+http://www.envolk.com/envolkspiderinfo.php)  Envolk Web Search robot  Info
envolk[ITS]spider/1.6(+http://www.envolk.com/envolkspider.html)  Envolk Web Search robot  Info
EroCrawler  EroCrawler adult search robot  Info
ES.NET_Crawler/2.0 (http://search.innerprise.net/)  Enterprise Search engine software (64.202.165.xxx)  Info
eseek-larbin_2.6.2 (crawler@exactseek.com)  ExactSEEK (Jayde Online) robot  Info
ESISmartSpider  ESI Smart-Spider toolkit  Info
eStyleSearch 4 (compatible; MSIE 6.0; Windows NT 5.0)  e-Style ISP search (Russia) robot (217.174.103.xxx)  Info
ESurf15a 15  Some site scanning tool via diff. IPs  Info
EuripBot/0.x (+http://www.eurip.com) GetFile  Eurip.com - European Internet Portal robot  Info
EuripBot/0.x (+http://www.eurip.com) GetRobots  Eurip.com - European Internet Portal robot  Info
EuripBot/0.x (+http://www.eurip.com) PreCheck  Eurip.com - European Internet Portal robot  Info
Eurobot/1.0 (http://www.ayell.eu)  Ayell Euronet business directory robot  Info
EvaalSE - bot@evaal.com  Evaal Search Engine robot  Info
eventax/1.3 (eventax; http://www.eventax.de/; info@eventax.de)  Eventax event search (Germany)  Info
Everest-Vulcan Inc./0.1 (R&D project; host=e-1-24; http://everest.vulcan.com/crawlerhelp)  Vulcan Inc. Everest crawler (in development)  Info
Everest-Vulcan Inc./0.1 (R&D project; http://everest.vulcan.com/crawlerhelp)  Vulcan Inc. Everest crawler (in development)  Info
Exabot-Images/1.0  Exalead Websearch image crawler (193.47.80.xx)  Info
Exabot-Test/1.0  Exalead (France) search robot (193.47.80.xx)  Info
Exabot/2.0  Exalead (France) search robot (193.47.80.xx)  Info
Exabot/3.0  Exalead (France) search robot (193.47.80.xx)  Info
ExactSearch  eXact Search Bar for IE  Info
ExactSeek Crawler/0.1  ExactSEEK (Jayde Online) robot  Info
exactseek-crawler-2.63 (crawler@exactseek.com)  ExactSEEK (Jayde Online) robot  Info
exactseek-pagereaper-2.63 (crawler@exactseek.com)  ExactSEEK (Jayde Online) robot  Info
exactseek.com  ExactSEEK (Jayde Online) robot (69.9.181.1xx)  Info
Exalead NG/MimeLive Client (convert/http/0.120)  Exalead (France) search robot (193.47.80.xx)  Info
Excalibur Internet Spider V6.5.4  Excalibur (now Convera) spider software  Info
Execrawl/1.0 (Execrawl; http://www.execrawl.com/; bot@execrawl.com)  Execrawl software search using nutch  Info
exooba crawler/exooba crawler (crawler for exooba.com; http://www.exooba.com/; info at exooba dot com)  exooba crawler for exooba search pre-alpha development  Info
exooba/exooba crawler (exooba; exooba)  exooba crawler for exooba search pre-alpha development  Info
ExperimentalHenrytheMiragoRobot  Mirago UK Robot  Info
Expired Domain Sleuth  Expired Domain Sleuth domain name tool  R C  Info
Express WebPictures (www.express-soft.com)  Express Web Pictures image browser  B D  Info
ExtractorPro  Extractor Pro e-mail collector  Info
Extreme Picture Finder  Exisoftware image grabber and downloading tool  Info
EyeCatcher (Download-tipp.de)/1.0  Download-Tipp Germany robot  Info
Factbot 1.09 (see http://www.factbites.com/webmasters.php)  Factbites search robot  Info
factbot : http://www.factbites.com/robots  Factbites search robot  Info
FaEdit/2.0.x  FaEdit Professional - Japanese bookmark manager  Info
FairAd Client  FairAd user  Info
FANGCrawl/0.01  Safe-t.net web filtering service  Info
FARK.com link verifier  Drew Curtis' FARK.com link checking  Info
Fast Crawler Gold Edition  Fast/Alltheweb crawler (66.151.181.xx)  Info
FAST Enterprise Crawler 6 (Experimental)  Fast/Alltheweb crawler (66.151.181.xx)  Info
FAST Enterprise Crawler 6 / Scirus scirus-crawler@fast.no; http://www.scirus.com/srsapp/contactus/  Fast Enterprise Crawler (66.151.181.xx) for Scirus scienctific information search  Info
FAST Enterprise Crawler 6 used by Cobra Development (admin@fastsearch.com)  Fast/Alltheweb crawler (66.151.181.xx)  Info
FAST Enterprise Crawler 6 used by Comperio AS (sts@comperio.no)  Comperio Web Miner based on Fast ESP  Info
FAST Enterprise Crawler 6 used by FAST (FAST)  Fast/Alltheweb crawler (66.151.181.xx)  Info
FAST Enterprise Crawler 6 used by Pages Jaunes (pvincent@pagesjaunes.fr)  Pages Jaunes business search (France) robot using Fast Enterprise Crawler  Info
FAST Enterprise Crawler 6 used by Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au)  Fast/Alltheweb crawler for Sensis.com.au Australian search (66.151.181.xx)  Info
FAST Enterprise Crawler 6 used by Singapore Press Holdings (crawler@sphsearch.sg)  SPH Search - Singapore related search using Fast crawler  Info
FAST Enterprise Crawler 6 used by WWU (wardi@uni-muenster.de)  FAST Enterprise Crawler used by WWU (University of Muenster - Germany)  Info
FAST Enterprise Crawler/6 (www.fastsearch.com)  Fast/Alltheweb crawler (66.151.181.xx)  Info
FAST Enterprise Crawler/6.4 (helpdesk at fast.no)  Fast/Alltheweb crawler (66.151.181.xx)  Info
FAST FirstPage retriever (compatible; MSIE 5.5; Mozilla/4.0)  Fast/Alltheweb crawler (66.151.181.xx)  Info
FAST MetaWeb Crawler (helpdesk at fastsearch dot com)  Fast/Alltheweb crawler (66.151.181.xx)  Info
Fast PartnerSite Crawler  Fast/Alltheweb crawler (66.151.181.xx)  Info
FAST-WebCrawler/2.2.10 (Multimedia Search) (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)  Fast/Alltheweb multimedia crawler  Info
FAST-WebCrawler/2.2.6 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/2.2.7 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)http://www.fast.no  Fast/Alltheweb crawler  Info
FAST-WebCrawler/2.2.8 (crawler@fast.no; http://www.fast.no/faq/faqfastwebsearch/faqfastwebcrawler.html)http://www.fast.no  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.2 test  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.3 (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.4/Nirvana (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.4/PartnerSite (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.5 (atw-crawler at fast dot no; http://fast.no/support.php?c=faqs/crawler)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.6 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.6/FirstPage (crawler@fast.no; http://fast.no/support.php?c=faqs/crawler)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.7 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.7/FirstPage (atw-crawler at fast dot no;http://fast.no/support/crawler.asp)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.8 (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.8/Fresh (atw-crawler at fast dot no; http://fast.no/support/crawler.asp)  Fast/Alltheweb crawler  Info
FAST-WebCrawler/3.x Multimedia  Fast/Alltheweb multimedia crawler  Info
FAST-WebCrawler/3.x Multimedia (mm dash crawler at fast dot no)  Fast/Alltheweb multimedia crawler  Info
fastbot crawler beta 2.0 (+http://www.fastbot.de)  Fastbot search Germany crawler (80.252.104.1xx)  Info
FastBug http://www.ay-up.com  Ay-Up geo sync search robot  Info
FastCrawler 3.0.1 (crawler@1klik.dk)  Fast/Alltheweb crawler (66.151.181.xx)  Info
FastSearch Web Crawler for Verizon SuperPages (kevin.watters@fastsearch.com)  Fast/Alltheweb crawler used by SuperPages.com  Info
Favcollector/2.0 (info@favcollector.com http://www.favcollector.com/)  Favcollector Favicon collecting robot  Info
FavIconizer  FavIconizer - IE favorites icons refreshing tool  Info
favo.eu crawler/0.6 (http://www.favo.eu)  favo.eu (Germany) search robot  Info
FavOrg  ZD's FavOrg favourites managing program  Info
Favorites Checking (http://campulka.net)  Campulka.net Favorites checking tool  Info
Favorites Sweeper v.2.03  Favorites Sweeper bookmark checker  Info
Faxobot/1.0  FaXo Search robot (69.152.89.xx)  Info
FDM 1.x  Free Download Manager (FDM) download accelerator   Info
FDM 2.x  Free Download Manager (FDM) download accelerator   Info
Feed Seeker Bot (RSS Feed Seeker http://www.MyNewFavoriteThing.com/fsb.php)  RSS Feed Seeker bot (68.225.95.2xx)  Info
Feed24.com  Feed24 news feed and blog search  Info
Feed::Find/0.0x  Feed::Find - Syndication feed (RSS/Atom) auto-discovery  Info
Feedable/0.1 (compatible; MSIE 6.0; Windows NT 5.1)  Feedable beta web based RSS service  Info
FeedChecker/0.01  Unknown robot from the University of Tokyo (157.82.157.xx)  Info
FeedDemon/2.7 (http://www.newsgator.com/; Microsoft Windows XP)  FeedDemon RSS reader  Info
Feedfetcher-Google-iGoogleGadgets; (+http://www.google.com/feedfetcher.html)  Google news feed feetcher for iGoogle gadgets  Info
Feedfetcher-Google; (+http://www.google.com/feedfetcher.html)  Google Feedfetcher - RSS and Atom feed crawler  Info
FeedForAll rss2html.php v2  FeedForAll RSS feed robot  Info
FeedHub FeedDiscovery/1.0 (http://www.feedhub.com)  FeedHub news feed personalization engine powered by mSpoke  Info
FeedHub MetaDataFetcher/1.0 (http://www.feedhub.com)  FeedHub news feed personalization engine powered by mSpoke  Info
Feedjit Favicon Crawler 1.0  Feedjit news feed service favicon crawler  Info
Feedreader 3.xx (Powered by Newsbrain)  Newsbrain Feedreader3  Info
Feedshow/x.0 (http://www.feedshow.com; 1 subscriber)  FeedShow online RSS feed reader  Info
FeedshowOnline (http://www.feedshow.com)  FeedShow online RSS feed reader  Info
FeedZcollector v1.x (Platinum) http://www.feeds4all.com/feedzcollector  FeedZcollector - Feed (RSS, ATOM and RDF) capturing software  Info
Felix - Mixcat Crawler (+http://mixcat.com)  MixCat robot  Info
fetch libfetch/2.0  FreeBSD download tool  Info
FFC Trap Door Spider  Frequent Finders spider via Sitefusion.com  Info
Filangy/0.01-beta (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com)  Filangy search and bookmark service  R C  Info
Filangy/1.0x (Filangy; http://www.filangy.com/filangyinfo.jsp?inc=robots.jsp; filangy-agent@filangy.com)  Filangy search and bookmark service  R C  Info
Filangy/1.0x (Filangy; http://www.nutch.org/docs/en/bot.html; filangy-agent@filangy.com)  Filangy search and bookmark service  R C  Info
fileboost.net/1.0 (+http://www.fileboost.net)  File Boost Network link checking  R C  Info
FileHound x.x  FileHound download manager  Info
Filtrbox/1.0  filtrbox media content (news) monitoring  Info
FindAnISP.com_ISP_Finder_v99a  Find An ISP robot  R C  Info
Findexa Crawler (http://www.findexa.no/gulesider/article26548.ece)  Yelo.no business search (Norway) via Findexa  Info
findlinks/x.xxx (+http://wortschatz.uni-leipzig.de/findlinks/)   NextLinks - German vocabulary and hyperlink search  Info
FineBot  Finesearch robot  Info
Finjan-prefetch  Finjan Vital Security Web Appliance security solution  Info
Firefly/1.0  Fireball.de robot  Info
Firefly/1.0 (compatible; Mozilla 4.0; MSIE 5.5)  Fireball.de robot  Info
Firefox (kastaneta03@hotmail.com)  Unknown robot from Czech Technical University Prague (147.32.141.xx)  Info
Firefox_1.0.6 (kasparek@naparek.cz)  Unknown robot from Czech Technical University Prague (147.32.141.xx)  Info
FirstGov.gov Search - POC:firstgov.webmasters@gsa.gov  AT&T/Fast Search robot for FirstGov (U.S.Government) portal  Info
firstsbot  Firstsfind Germany robot / link checking  Info
Flapbot/0.7.2 (Flaptor Crawler; http://www.flaptor.com; crawler at flaptor period com)  Flaptor information retrieval solutions robot  Info
FlashGet  JetCar/FlashGet download manager  Info
FLATARTS_FAVICO  FlatArts Favorites Icon Tool  C D  Info
Flexum spider  Flexum.ru search service  Info
Flexum/2.0  Flexum.ru search service  Info
FlickBot 2.0 RPT-HTTPClient/0.3-3  DivX.com Movie Find robot  Info
flunky  Metacarta / Cogent robot  Info
fly/6.01 libwww/4.0D  unknown    Info
flyindex.net 1.0/http://www.flyindex.net  FLY Index Metasearch link checking  Info
FnooleBot/2.5.2 (+http://www.fnoole.com/addurl.html)  Fnoole news crawler  Info
FocusedSampler/1.0  IBM's Almaden Research robot  Info
Folkd.com Spider/0.1 beta 1 (www.folkd.com)  folkd.com social search robot  Info
FollowSite Bot ( http://www.followsite.com/bot.html )  FollowSite robot - website monitoring  Info
FollowSite.com ( http://www.followsite.com/b.html )  FollowSite robot - website monitoring  Info
Fooky.com/ScorpionBot/ScoutOut; http://www.fooky.com/scorpionbots  Fooky search Scorpionbots robot (65.12.170.xxx)  Info
Francis/1.0 (francis@neomo.de http://www.neomo.de/)  Neomo Search (Germany) robot (85.10.197.1xx)  Info
Franklin Locator 1.8  Some spam bot  Info
free-downloads.net download-link validator /0.1  Free Downloads shareware directory link checking  Info
FreeFind.com-SiteSearchEngine/1.0 (http://freefind.com; spiderinfo@freefind.com)  FreeFind.com robot  Info
Frelicbot/1.0 +http://www.frelic.com/  Frelics backlink checking bot (beta)  Info
FreshDownload/x.xx  Fresh Download download manager  Info
FreshNotes crawler< report problems to crawler-at-freshnotes-dot-com  FreshNotes - music related artist search (72.3.225.xx)  Info
FSurf15a 01  Some site scanning tool via diff. IPs  Info
FTB-Bot http://www.findthebest.co.uk/  Find the Best search robot  Info
Full Web Bot 0416B  Some site scanning tool from diff. IPs i.e.: - 66.28.240.xx (cogentco.com) - 68.5.174.xx (cox.net)  Info
Full Web Bot 0516B  Some site scanning tool i.e. from - 68.154.96.xx (bellsouth.net)  Info
Full Web Bot 2816B  Some site scanning tool from 66.255.6.xxx (uslec.com)  Info
FuseBulb.Com  FuseBulb search  Info
FyberSpider (+http://www.fybersearch.com/fyberspider.php)  FyberSearch FyberSpider robot  Info
unknownght.com Web Server IIS vs Apache Survey. See Results at www.DNSRight.com  DNS Right - Online DNS tools  Info
A - F & Additions
G - L
M
N - S
T - Z

Legend
B
(Client) browser
C
Link-, bookmark-, server- checking
D
Downloading tool
P
Proxy server, web filtering
R
Robot, crawler, spider
S
Spam or bad bot

2002-2011Andreas Staeding

a Psychedelix.com product

Home || Links || Banners || Feedback & Additions || E-Mail