| Search Engine | Hits | Last Hit |
| Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) |
11347 |
2008-11-18 10:45:35 |
| Mediapartners-Google/2.1 |
547 |
2007-08-10 13:17:29 |
| Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com) |
54 |
2006-01-09 17:54:58 |
| Googlebot/2.1 (+http://www.google.com/bot.html) |
58 |
2006-03-21 12:52:47 |
| NG/2.0 |
27 |
2005-12-19 02:47:00 |
| NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) |
4 |
2005-08-31 13:57:30 |
| Baiduspider+(+http://www.baidu.com/search/spider.htm) |
2 |
2005-09-11 19:10:07 |
| Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html) |
106 |
2007-10-11 12:00:18 |
| msnbot/1.0 (+http://search.msn.com/msnbot.htm) |
1549 |
2008-02-06 07:45:43 |
| Mozilla/4.0 (compatible; grub-client-2.6.0) |
21 |
2005-10-06 08:34:00 |
| Steeler/3.1 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) |
45 |
2006-06-22 03:07:24 |
| Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au) |
1 |
2005-04-21 21:42:28 |
| Mozilla/5.0 (compatible; BecomeBot/2.2.5; MSIE 6.0 compatible; +http://www.become.com/site_owners.html) |
1 |
2005-04-27 06:56:27 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-13.zyborg@looksmart.net; http://www.WISEnutbot.com) |
1 |
2005-04-28 15:51:59 |
| appie 1.1 (www.walhello.com) |
1 |
2005-05-01 17:14:39 |
| Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) |
1782 |
2008-11-18 12:02:01 |
| DiamondBot |
16 |
2006-05-08 20:31:58 |
| Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; MSIECrawler) |
2 |
2005-05-09 15:37:21 |
| aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com) |
12 |
2006-06-04 17:21:49 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net; http://www.WISEnutbot.com) |
130 |
2007-01-20 18:21:49 |
| Mozilla/5.0 (compatible; heritrix/1.3.0 +http://www.l3s.de/) |
1 |
2005-05-18 17:28:30 |
| Java/1.4.2_05 |
2 |
2005-10-12 16:49:07 |
| Mozilla/5.0 (compatible; BecomeBot/1.86; MSIE 6.0 compatible; +http://www.become.com/site_owners.html) |
1 |
2005-05-24 05:56:08 |
| IRLbot/1.0 (+http://irl.cs.tamu.edu/crawler) |
4 |
2005-06-08 08:33:41 |
| ia_archiver |
300 |
2008-09-13 14:44:52 |
| ichiro/1.0 (ichiro@nttr.co.jp) |
4 |
2005-09-10 07:55:26 |
| Mozilla/5.0 (compatible; BecomeBot/2.3; MSIE 6.0 compatible; +http://www.become.com/site_owners.html) |
13 |
2006-06-10 10:19:22 |
| noxtrumbot/1.0 (crawler@noxtrum.com) |
164 |
2008-05-13 06:48:41 |
| Gigabot/2.0 |
9 |
2006-01-11 20:14:46 |
| nicebot |
3 |
2005-12-12 14:15:58 |
| StackRambler/2.0 (MSIE incompatible) |
111 |
2006-01-14 08:18:45 |
| psbot/0.1 (+http://www.picsearch.com/bot.html) |
94 |
2008-10-29 23:36:08 |
| snap.com beta crawler v0 |
1 |
2006-01-12 05:20:09 |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/) |
10 |
2007-03-24 08:32:44 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (http://www.voila.com/) |
9 |
2008-04-10 07:45:22 |
| Mediapartners-Google |
248 |
2008-11-16 21:24:00 |
| msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) |
88 |
2008-11-16 03:06:30 |
| Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) |
125 |
2008-05-03 13:10:55 |
| voyager-hc/1.0 (+http://www.kosmix.com/crawler.html) |
4 |
2008-02-01 14:57:40 |
| Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) |
200 |
2008-11-17 10:55:15 |
| WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) |
15 |
2008-08-28 05:23:31 |
| Yandex/1.01.001 (compatible; Win16; I) |
186 |
2008-11-11 18:09:27 |
| e-SocietyRobot(http://www.yama.info.waseda.ac.jp/~yamana/es/) |
2 |
2008-03-19 21:46:44 |
| boitho.com-dc/0.86 ( http://www.boitho.com/dcbot.html ) |
34 |
2008-09-08 23:21:55 |
| boitho.com-dc/0.85 ( http://www.boitho.com/dcbot.html ) |
34 |
2008-11-02 15:44:03 |
| Yeti/0.01 (nhn/1noon, yetibot@naver.com, check robots.txt daily and follow it) |
2 |
2008-03-13 13:45:13 |
| Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) |
34 |
2008-02-29 21:36:59 |
| Gigabot/3.0 (http://www.gigablast.com/spider.html) |
2 |
2008-09-05 01:45:26 |
| PRCrawler/Nutch-0.9 (data mining development project) |
1 |
2008-03-09 08:28:44 |
| Mozilla/5.0 (compatible; Charlotte/1.0b; http://www.searchme.com/support/) |
1 |
2008-04-05 15:45:33 |
| Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) |
1 |
2008-05-23 14:51:45 |
| GurujiBot/1.0 (+http://www.guruji.com/en/WebmasterFAQ.html) |
1 |
2008-08-18 20:03:00 |
| Mozilla/4.0 (compatible; NaverBot/1.0; http://help.naver.com/delete_main.asp) |
2 |
2008-10-01 20:09:21 |
| Speedy Spider (http://www.entireweb.com/about/search_tech/speedy_spider/) |
1 |
2008-10-11 11:44:14 |
| Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98) |
1 |
2008-10-19 22:39:00 |