| Search Engine | Hits | Last Hit |
| Mozilla/4.0 compatible ZyBorg/1.0 Dead Link Checker (wn.dlc@looksmart.net; http://www.WISEnutbot.com) |
37 |
2005-06-18 20:11:35 |
| Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp) |
6406 |
2008-11-16 11:25:34 |
| Googlebot/2.1 (+http://www.google.com/bot.html) |
171 |
2006-03-20 21:15:12 |
| accoona |
2 |
2005-04-29 04:13:01 |
| NG/2.0 |
42 |
2005-12-22 04:54:23 |
| msnbot/1.0 (+http://search.msn.com/msnbot.htm) |
1551 |
2008-01-05 04:43:26 |
| NutchCVS/0.06-dev (Nutch; http://www.nutch.org/docs/en/bot.html; nutch-agent@lists.sourceforge.net) |
10 |
2005-08-31 13:41:58 |
| Mozilla/2.0 (compatible; Ask Jeeves/Teoma; +http://sp.ask.com/docs/about/tech_crawling.html) |
108 |
2007-10-09 08:02:18 |
| Gigabot/2.0 |
22 |
2007-05-06 17:22:57 |
| Mozilla/4.0 (compatible; grub-client-2.6.0) |
17 |
2005-09-25 04:25:04 |
| Sensis.com.au Web Crawler (search_comments\at\sensis\dot\com\dot\au) |
1 |
2005-04-21 21:40:26 |
| Mozilla/5.0 (compatible; BecomeBot/2.2.5; MSIE 6.0 compatible; +http://www.become.com/site_owners.html) |
1 |
2005-04-27 06:48:13 |
| Steeler/3.1 (http://www.tkl.iis.u-tokyo.ac.jp/~crawler/) |
37 |
2006-06-16 00:21:18 |
| Mediapartners-Google/2.1 |
353 |
2007-08-09 21:55:47 |
| IRLbot/1.0 (+http://irl.cs.tamu.edu/crawler) |
4 |
2005-06-08 06:45:20 |
| DiamondBot |
8 |
2005-11-07 22:20:36 |
| aipbot/1.0 (aipbot; http://www.aipbot.com; aipbot@aipbot.com) |
21 |
2006-06-05 14:47:43 |
| Mozilla/4.0 compatible ZyBorg/1.0 (wn-14.zyborg@looksmart.net; http://www.WISEnutbot.com) |
120 |
2007-01-24 21:24:01 |
| Mozilla/5.0 (compatible; heritrix/1.3.0 +http://www.l3s.de/) |
1 |
2005-05-18 16:33:29 |
| Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html) |
1146 |
2008-11-13 05:07:27 |
| ichiro/1.0 (ichiro@nttr.co.jp) |
3 |
2005-09-10 07:28:37 |
| Pompos/1.3 http://dir.com/pompos.html |
1 |
2005-06-11 10:54:30 |
| Mozilla/5.0 (compatible; BecomeBot/2.3; MSIE 6.0 compatible; +http://www.become.com/site_owners.html) |
9 |
2006-06-10 10:58:03 |
| nicebot |
7 |
2006-01-12 15:26:15 |
| IWantMyXXX/1.0 (http://www.iwantmyxxx.com/) |
2 |
2005-10-26 18:24:47 |
| noxtrumbot/1.0 (crawler@noxtrum.com) |
114 |
2007-07-07 14:18:30 |
| Java/1.4.2_05 |
2 |
2005-10-12 16:49:49 |
| StackRambler/2.0 (MSIE incompatible) |
47 |
2006-01-17 07:31:28 |
| psbot/0.1 (+http://www.picsearch.com/bot.html) |
66 |
2008-10-30 03:56:47 |
| ia_archiver |
154 |
2008-10-16 23:58:09 |
| snap.com beta crawler v0 |
1 |
2006-01-12 00:04:38 |
| Mozilla/4.0 (compatible; MSIE 5.0; Windows 95) VoilaBot BETA 1.2 (http://www.voila.com/) |
13 |
2007-03-25 02:13:56 |
| Mozilla/5.0 (Windows; U; Windows NT 5.1; fr; rv:1.8.1) VoilaBot BETA 1.2 (http://www.voila.com/) |
12 |
2008-05-29 17:28:13 |
| Mozilla/5.0 (compatible; Ask Jeeves/Teoma; +http://about.ask.com/en/docs/about/webmasters.shtml) |
169 |
2008-11-12 10:25:57 |
| Mediapartners-Google |
251 |
2008-11-18 11:53:00 |
| Mozilla/5.0 (Twiceler-0.9 http://www.cuill.com/twiceler/robot.html) |
159 |
2008-05-09 01:58:27 |
| Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot) |
9 |
2008-03-24 16:08:25 |
| msnbot-media/1.0 (+http://search.msn.com/msnbot.htm) |
43 |
2008-11-15 07:06:55 |
| Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+) |
29 |
2008-09-08 02:18:03 |
| Yeti/0.01 (nhn/1noon, yetibot@naver.com, check robots.txt daily and follow it) |
3 |
2008-03-10 07:34:42 |
| WebAlta Crawler/2.0 (http://www.webalta.net/ru/about_webmaster.html) (Windows; U; Windows NT 5.1; ru-RU) |
4 |
2008-08-30 08:00:52 |
| boitho.com-dc/0.86 ( http://www.boitho.com/dcbot.html ) |
3 |
2008-10-24 07:03:06 |
| Mozilla/5.0 (compatible; Charlotte/1.0b; http://www.searchme.com/support/) |
1 |
2008-04-13 04:04:07 |
| boitho.com-dc/0.85 ( http://www.boitho.com/dcbot.html ) |
1 |
2008-05-12 21:22:44 |
| bot/1.0 (bot; http://; bot@bot.bot) |
1 |
2008-05-16 19:47:12 |
| Yandex/1.01.001 (compatible; Win16; I) |
39 |
2008-11-11 18:06:46 |
| Gigabot/3.0 (http://www.gigablast.com/spider.html) |
3 |
2008-11-15 22:07:40 |
| Mozilla/4.0 (compatible; NaverBot/1.0; http://help.naver.com/delete_main.asp) |
1 |
2008-09-12 11:32:46 |
| Gaisbot/3.0+(robot06@gais.cs.ccu.edu.tw;+http://gais.cs.ccu.edu.tw/robot.php) |
1 |
2008-10-09 07:54:02 |
| Mozilla/4.5 (compatible; HTTrack 3.0x; Windows 98) |
1 |
2008-10-20 04:47:03 |