| 51 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 267389 | 468.17 MB | 31 Oct 2012 - 23:59 |
| Googlebot | 35088+214 | 285.57 MB | 31 Oct 2012 - 23:59 |
| Unknown robot (identified by 'crawl') | 5589+1691 | 13.01 MB | 31 Oct 2012 - 23:55 |
| BaiDuSpider | 5702+70 | 96.73 MB | 31 Oct 2012 - 23:51 |
| Unknown robot (identified by 'bot/' or 'bot-') | 4168+384 | 92.81 MB | 31 Oct 2012 - 23:59 |
| Yandex bot | 960+152 | 15.96 MB | 31 Oct 2012 - 23:44 |
| MSNBot | 933+16 | 2.44 MB | 31 Oct 2012 - 13:21 |
| Python-urllib | 757+16 | 185.28 MB | 31 Oct 2012 - 23:19 |
| Unknown robot (identified by 'spider') | 589+31 | 59.19 MB | 31 Oct 2012 - 22:59 |
| Unknown robot (identified by hit on 'robots.txt') | 0+386 | 138.79 KB | 31 Oct 2012 - 21:12 |
| Unknown robot (identified by 'robot') | 185+183 | 4.40 MB | 31 Oct 2012 - 07:01 |
| MagpieRSS | 299+15 | 595.81 KB | 31 Oct 2012 - 20:59 |
| FAST Enterprise Crawler | 256+5 | 1.77 MB | 30 Oct 2012 - 00:32 |
| Nutch | 133+73 | 3.16 MB | 30 Oct 2012 - 14:06 |
| Yahoo Slurp | 141+39 | 16.60 MB | 31 Oct 2012 - 18:10 |
| MJ12bot | 91+66 | 2.56 MB | 31 Oct 2012 - 22:40 |
| TencentTraveler | 89 | 37.91 MB | 31 Oct 2012 - 22:57 |
| Feedfetcher-Google | 75 | 1.49 MB | 31 Oct 2012 - 23:45 |
| SeznamBot | 50+16 | 1.53 MB | 30 Oct 2012 - 17:02 |
| Java (Often spam bot) | 56+2 | 975.08 KB | 16 Oct 2012 - 10:27 |
| MSNBot-media | 30+24 | 1.15 MB | 31 Oct 2012 - 14:33 |
| BSpider | 34+14 | 72.42 KB | 30 Oct 2012 - 23:59 |
| Exabot | 40+7 | 292.61 KB | 30 Oct 2012 - 21:28 |
| psbot | 16+8 | 417.35 KB | 28 Oct 2012 - 00:12 |
| Alexa (IA Archiver) | 5+17 | 1.44 MB | 31 Oct 2012 - 09:57 |
| CFNetwork | 20 | 32.13 MB | 30 Oct 2012 - 15:15 |
| Heritrix | 18 | 68.11 KB | 07 Oct 2012 - 07:43 |
| Xenu Link Sleuth | 17 | 18.03 KB | 30 Oct 2012 - 05:29 |
| Phantom | 13 | 74.32 KB | 22 Oct 2012 - 14:37 |
| DoCoMo | 0+13 | 4.46 KB | 30 Oct 2012 - 07:39 |
| Netcraft | 12 | 30.77 KB | 29 Oct 2012 - 23:02 |
| ichiro | 1+11 | 679.23 KB | 25 Oct 2012 - 06:42 |
| Voila | 6+5 | 15.62 KB | 17 Oct 2012 - 02:31 |
| Microsoft URL Control | 10 | 43.99 KB | 28 Oct 2012 - 00:18 |
| archive.org bot | 0+6 | 2.06 KB | 14 Oct 2012 - 05:25 |
| Web Core / Roots | 5 | 6.09 MB | 20 Oct 2012 - 15:05 |
| Yahoo! Slurp China | 5 | 2.06 MB | 26 Oct 2012 - 02:52 |
| WebCollage | 4 | 1.71 MB | 28 Oct 2012 - 17:12 |
| SurveyBot | 1+2 | 2.68 KB | 21 Oct 2012 - 17:30 |
| Turn It In | 1+2 | 702 Bytes | 09 Oct 2012 - 06:14 |
| Y!J Yahoo Japan | 1+2 | 2.83 KB | 29 Oct 2012 - 20:24 |
| legs | 1+2 | 2.75 KB | 31 Oct 2012 - 14:18 |
| NG 1.x (Exalead) | 2 | 124.83 KB | 20 Oct 2012 - 05:03 |
| HTMLParser | 2 | 8.22 KB | 20 Oct 2012 - 04:34 |
| Findlinks | 1+1 | 2.49 KB | 26 Oct 2012 - 11:02 |
| HTTrack off-line browser | 2 | 3.95 KB | 05 Oct 2012 - 06:47 |
| WebFilter | 2 | 18.08 KB | 23 Oct 2012 - 05:12 |
| W3C jigsaw CSS Validator | 1 | 4.93 KB | 16 Oct 2012 - 22:57 |
| Combine System | 0+1 | 351 Bytes | 08 Oct 2012 - 04:09 |
| FeedValidator | 1 | 4.89 KB | 16 Oct 2012 - 22:57 |
| yacy | 0+1 | 389 Bytes | 10 Oct 2012 - 14:16 |