| 63 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 844421 | 5.62 GB | 30 Sep 2009 - 23:59 |
| MSNBot | 635835 | 23.34 GB | 30 Sep 2009 - 23:59 |
| MLBot | 317288 | 3.17 GB | 30 Sep 2009 - 23:54 |
| Unknown robot (identified by 'robot') | 98443 | 1.42 GB | 30 Sep 2009 - 08:25 |
| FAST Enterprise Crawler | 58592 | 1.61 GB | 30 Sep 2009 - 23:59 |
| Googlebot | 38691 | 8.00 GB | 30 Sep 2009 - 23:59 |
| Yahoo Slurp | 25729 | 11.86 GB | 30 Sep 2009 - 23:52 |
| Java (Often spam bot) | 16229 | 2.59 GB | 30 Sep 2009 - 23:54 |
| Unknown robot (identified by 'crawl') | 11077 | 360.03 MB | 30 Sep 2009 - 22:30 |
| Nagios | 7781 | 91.21 MB | 30 Sep 2009 - 23:40 |
| Heritrix | 7032 | 1.82 GB | 20 Sep 2009 - 17:06 |
| MJ12bot | 2424 | 114.32 MB | 27 Sep 2009 - 04:06 |
| BaiDuSpider | 1697 | 25.72 MB | 30 Sep 2009 - 21:24 |
| Unknown robot (identified by 'spider') | 766 | 8.46 MB | 30 Sep 2009 - 19:09 |
| Yandex bot | 589 | 2.81 MB | 30 Sep 2009 - 09:25 |
| Yahoo-MMCrawler | 532 | 200.14 MB | 01 Sep 2009 - 08:55 |
| Alexa (IA Archiver) | 503 | 7.88 MB | 30 Sep 2009 - 22:10 |
| LiveJournal.com | 358 | 13.98 MB | 30 Sep 2009 - 20:12 |
| Speedy Spider | 342 | 1.94 MB | 30 Sep 2009 - 18:17 |
| Ask | 299 | 27.05 MB | 30 Sep 2009 - 13:24 |
| Jakarta commons-httpclient | 215 | 56.11 MB | 30 Sep 2009 - 21:21 |
| Voila | 199 | 12.37 MB | 30 Sep 2009 - 22:20 |
| Turn It In | 154 | 17.38 MB | 29 Sep 2009 - 13:09 |
| Exabot | 152 | 738.45 KB | 30 Sep 2009 - 09:28 |
| Unknown robot (identified by 'bot/' or 'bot-') | 141 | 1.94 MB | 30 Sep 2009 - 20:01 |
| CFNetwork | 115 | 1.46 GB | 30 Sep 2009 - 09:26 |
| Nutch | 92 | 2.16 MB | 30 Sep 2009 - 23:31 |
| MojeekBot | 69 | 359.56 KB | 28 Sep 2009 - 19:25 |
| DoCoMo | 63 | 1.07 MB | 22 Sep 2009 - 17:03 |
| Custo | 48 | 36.38 MB | 30 Sep 2009 - 19:45 |
| Python-urllib | 48 | 23.81 MB | 30 Sep 2009 - 12:34 |
| GigaBot | 34 | 140.18 KB | 30 Sep 2009 - 17:03 |
| UP.Browser | 25 | 23.41 MB | 29 Sep 2009 - 18:28 |
| larbin | 21 | 251.50 KB | 30 Sep 2009 - 22:25 |
| Netcraft | 21 | 99.76 KB | 30 Sep 2009 - 02:25 |
| Web Core / Roots | 20 | 21.65 MB | 29 Sep 2009 - 20:49 |
| legs | 15 | 1.64 MB | 30 Sep 2009 - 12:01 |
| HTTrack off-line browser | 13 | 28.06 MB | 16 Sep 2009 - 06:41 |
| psbot | 12 | 6.73 KB | 20 Sep 2009 - 08:31 |
| Microsoft URL Control | 10 | 2.14 MB | 26 Sep 2009 - 08:14 |
| TencentTraveler | 10 | 9.90 MB | 29 Sep 2009 - 22:39 |
| WordPress | 9 | 429.80 KB | 06 Sep 2009 - 13:46 |
| VSE | 9 | 18.71 MB | 26 Sep 2009 - 06:13 |
| W3C Validator | 8 | 47.66 KB | 03 Sep 2009 - 00:01 |
| Yahoo! Slurp China | 7 | 32.59 KB | 30 Sep 2009 - 00:50 |
| Ocelli | 7 | 21.78 KB | 07 Sep 2009 - 00:28 |
| Grub.org | 6 | 1.56 KB | 24 Sep 2009 - 05:00 |
| yacy | 5 | 87.34 KB | 28 Sep 2009 - 18:32 |
| MSIECrawler | 4 | 63.16 KB | 17 Sep 2009 - 04:27 |
| WebCollage | 3 | 87.66 KB | 03 Sep 2009 - 11:09 |
| Powermarks | 2 | 51.28 KB | 27 Sep 2009 - 11:24 |
| WallPaper (alias crawlpaper) | 2 | 201.08 KB | 08 Sep 2009 - 06:41 |
| HTMLParser | 2 | 52.85 KB | 27 Sep 2009 - 00:26 |
| SurveyBot | 2 | 21.97 KB | 15 Sep 2009 - 14:24 |
| Motor | 2 | 3.39 MB | 23 Sep 2009 - 12:19 |
| Voyager | 2 | 1.67 MB | 25 Sep 2009 - 21:35 |
| BBot | 2 | 130.02 KB | 05 Sep 2009 - 03:01 |
| Digger | 1 | 10.74 KB | 05 Sep 2009 - 19:37 |
| SuperBot | 1 | 41.30 KB | 01 Sep 2009 - 09:19 |
| mnoGoSearch search engine software | 1 | 11.22 KB | 30 Sep 2009 - 00:53 |
| Cursor | 1 | 5.40 MB | 08 Sep 2009 - 18:27 |
| Xenu Link Sleuth | 1 | 283 Bytes | 24 Sep 2009 - 03:44 |
| Fish search | 1 | 701.55 KB | 21 Sep 2009 - 14:04 |