| Search Engine | Hits | Last Hit |
| Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) |
2984 |
2008-11-17 00:59:52 |
| Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com) |
18 |
2005-06-02 17:23:39 |
| Mediapartners-Google/2.1 |
384 |
2007-08-10 08:02:19 |
| Googlebot/2.1 (+http://www.google.com/bot.html) |
91 |
2006-03-19 01:23:06 |
| NG/2.0 |
3 |
2005-12-21 15:06:28 |
| NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) |
2 |
2005-04-16 09:01:00 |
| Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html) |
85 |
2006-08-21 07:03:55 |
| msnbot/1.0 (+http://search.msn.com/msnbot.htm) |
293 |
2008-02-07 11:20:29 |
| Baiduspider+(+http://www.baidu.com/search/spider.htm) |
8 |
2008-11-15 06:44:21 |
| Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au) |
1 |
2005-04-21 21:43:12 |
| Gigabot/2.0 |
20 |
2007-05-04 09:41:04 |
| Mozilla/5.0 (compatible; BecomeBot/2.2.5; MSIE 6.0 compatible; +http://www.become.com/site_owners.html) |
1 |
2005-04-28 01:16:42 |
| Mozilla/4.0 (compatible; grub-client-2.6.0) |
10 |
2005-09-26 13:05:03 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-13.zyborg@looksmart.net; http://www.WISEnutbot.com) |
1 |
2005-05-01 00:36:09 |
| Steeler/3.1 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) |
19 |
2006-06-22 08:37:01 |
| DiamondBot |
9 |
2006-05-08 20:32:01 |
| Java/1.4.2_05 |
1 |
2005-05-09 03:20:44 |
| aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com) |
10 |
2006-01-28 13:22:09 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net; http://www.WISEnutbot.com) |
29 |
2007-01-21 08:05:07 |
| Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) |
638 |
2008-11-17 05:25:32 |
| ichiro/1.0 (ichiro@nttr.co.jp) |
4 |
2005-09-10 08:52:25 |
| Mozilla/5.0 (compatible; BecomeBot/2.3; MSIE 6.0 compatible; +http://www.become.com/site_owners.html) |
11 |
2006-06-09 22:37:45 |
| noxtrumbot/1.0 (crawler@noxtrum.com) |
36 |
2008-05-14 03:05:06 |
| nicebot |
2 |
2006-03-09 12:33:45 |
| ia_archiver |
58 |
2008-11-06 17:26:25 |
| psbot/0.1 (+http://www.picsearch.com/bot.html) |
34 |
2008-10-28 10:55:01 |
| StackRambler/2.0 (MSIE incompatible) |
2 |
2006-01-04 15:15:52 |
| http://www.almaden.ibm.com/cs/crawler [bc3] |
2 |
2006-01-22 17:51:34 |
| Gigabot/1.0 |
2 |
2007-05-16 18:03:57 |
| Mediapartners-Google |
309 |
2008-11-16 20:55:07 |
| voyager-hc/1.0 (+http://www.kosmix.com/crawler.html) |
1 |
2008-02-01 05:30:52 |
| WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) |
24 |
2008-08-31 13:45:06 |
| Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) |
57 |
2008-05-30 08:38:15 |
| Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) |
55 |
2008-10-29 12:29:31 |
| Yandex/1.01.001 (compatible; Win16; I) |
47 |
2008-11-14 15:51:02 |
| boitho.com-dc/0.86 ( http://www.boitho.com/dcbot.html ) |
4 |
2008-08-29 22:45:34 |
| Yeti/0.01 (nhn/1noon, yetibot@naver.com, check robots.txt daily and follow it) |
3 |
2008-03-13 16:51:41 |
| Mozilla/5.0 (compatible; YodaoBot/1.0; http://www.yodao.com/help/webmaster/spider/; ) |
8 |
2008-07-20 19:24:13 |
| msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) |
26 |
2008-11-18 06:28:44 |
| PRCrawler/Nutch-0.9 (data mining development project) |
2 |
2008-03-25 17:41:00 |
| Mozilla/5.0 (compatible; Charlotte/1.0b; http://www.searchme.com/support/) |
3 |
2008-04-13 08:04:52 |
| Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) |
11 |
2008-09-08 02:14:43 |
| TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html) |
1 |
2008-05-05 04:37:41 |
| bot/1.0 (bot; http://; bot@bot.bot) |
1 |
2008-05-16 15:08:45 |
| Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) |
2 |
2008-11-10 08:24:51 |
| Mozilla/5.0 (compatible; BecomeBot/3.0; +http://www.become.com/site_owners.html) |
1 |
2008-06-18 12:42:49 |
| Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98) |
1 |
2008-10-20 06:39:40 |