| 96 different robots | Hits | Bandwidth | Last visit |
|---|
| Load Balancing Server | 473312 | 1.27 GB | 31 May 2011 - 23:59 |
| Googlebot | 289090+390 | 7.65 GB | 31 May 2011 - 23:59 |
| Yahoo Slurp | 70051+458 | 9.75 GB | 31 May 2011 - 23:57 |
| Yandex bot | 44736+332 | 2.28 GB | 31 May 2011 - 23:59 |
| Unknown robot (identified by 'bot/' or 'bot-') | 34798+3031 | 1.14 GB | 31 May 2011 - 23:59 |
| Unknown robot (identified by 'crawl') | 26807+9054 | 161.55 MB | 31 May 2011 - 23:46 |
| Unknown robot (identified by 'robot') | 24840+117 | 281.61 MB | 31 May 2011 - 22:48 |
| FAST Enterprise Crawler | 16811+52 | 1019.75 MB | 31 May 2011 - 22:27 |
| Ocelli | 13521+1 | 1.56 GB | 28 May 2011 - 21:16 |
| Nagios | 13314 | 38.83 MB | 31 May 2011 - 23:59 |
| WebVac | 9495+1 | 50.17 MB | 28 May 2011 - 19:02 |
| Exabot | 4574+58 | 43.50 MB | 31 May 2011 - 23:53 |
| Unknown robot (identified by 'spider') | 3611+220 | 98.80 MB | 31 May 2011 - 23:56 |
| Python-urllib | 3608+10 | 1.98 GB | 31 May 2011 - 23:53 |
| MSNBot-media | 2440+1128 | 205.64 MB | 31 May 2011 - 23:48 |
| MJ12bot | 3105+338 | 60.02 MB | 31 May 2011 - 13:52 |
| BaiDuSpider | 3052+291 | 141.20 MB | 31 May 2011 - 23:21 |
| Voila | 2886+117 | 156.01 MB | 31 May 2011 - 23:12 |
| Speedy Spider | 2172+309 | 25.71 MB | 31 May 2011 - 23:37 |
| Java (Often spam bot) | 2209+10 | 520.31 MB | 31 May 2011 - 23:36 |
| Feedfetcher-Google | 1521 | 123.08 MB | 31 May 2011 - 22:26 |
| Fish search | 1417 | 26.18 MB | 31 May 2011 - 04:48 |
| WordPress | 1311 | 11.39 MB | 31 May 2011 - 23:27 |
| CFNetwork | 1082 | 507.62 MB | 31 May 2011 - 23:17 |
| Unknown robot (identified by hit on 'robots.txt') | 0+1013 | 448.42 KB | 31 May 2011 - 21:14 |
| psbot | 916+57 | 574.09 KB | 31 May 2011 - 07:41 |
| UP.Browser | 853 | 263.18 MB | 31 May 2011 - 23:32 |
| Motor | 673+2 | 46.17 MB | 31 May 2011 - 23:12 |
| Nutch | 550+74 | 225.65 MB | 31 May 2011 - 22:53 |
| bender focused_crawler | 507+84 | 7.06 MB | 31 May 2011 - 13:52 |
| Heritrix | 541+18 | 20.96 MB | 31 May 2011 - 18:58 |
| Alexa (IA Archiver) | 299+204 | 4.80 MB | 31 May 2011 - 22:52 |
| MLBot | 419+78 | 3.20 MB | 31 May 2011 - 18:47 |
| Powermarks | 418 | 463.47 KB | 31 May 2011 - 23:19 |
| BSpider | 369+26 | 8.27 MB | 31 May 2011 - 23:44 |
| Custo | 316+73 | 21.93 MB | 31 May 2011 - 21:58 |
| DoCoMo | 293+79 | 8.45 MB | 31 May 2011 - 17:49 |
| Yahoo! Slurp China | 269+91 | 10.59 MB | 31 May 2011 - 23:46 |
| ichiro | 274+51 | 8.17 MB | 25 May 2011 - 09:50 |
| TencentTraveler | 288 | 18.43 MB | 31 May 2011 - 23:40 |
| GigaBot | 182+89 | 586.17 KB | 30 May 2011 - 23:57 |
| Ask | 155+39 | 10.23 MB | 31 May 2011 - 20:40 |
| Web Core / Roots | 178 | 362.82 MB | 31 May 2011 - 18:56 |
| WallPaper (alias crawlpaper) | 163 | 22.11 MB | 31 May 2011 - 23:29 |
| Jakarta commons-httpclient | 150 | 29.09 MB | 31 May 2011 - 21:06 |
| archive.org bot | 139+5 | 33.71 MB | 22 May 2011 - 13:08 |
| MagpieRSS | 116+22 | 689.62 KB | 31 May 2011 - 23:51 |
| legs | 58+53 | 7.45 MB | 31 May 2011 - 23:01 |
| Findlinks | 38+59 | 854.39 KB | 31 May 2011 - 20:42 |
| The web archive (IA Archiver) | 0+91 | 34.17 KB | 19 May 2011 - 16:14 |
| MSNBot | 64+23 | 380.62 KB | 31 May 2011 - 21:02 |
| Netcraft | 73 | 170.50 KB | 31 May 2011 - 09:37 |
| HTTrack off-line browser | 47+15 | 14.00 MB | 30 May 2011 - 17:52 |
| VORTEX | 57 | 6.20 MB | 30 May 2011 - 14:03 |
| VSE | 44 | 12.15 MB | 31 May 2011 - 14:07 |
| larbin | 22+18 | 3.25 MB | 24 May 2011 - 05:30 |
| yacy | 17+19 | 9.79 MB | 31 May 2011 - 09:43 |
| Turn It In | 28+2 | 2.21 MB | 17 May 2011 - 17:42 |
| SuperBot | 27 | 63.72 KB | 23 May 2011 - 15:39 |
| Xenu Link Sleuth | 25 | 7.01 KB | 26 May 2011 - 20:52 |
| SurveyBot | 17+3 | 62.35 KB | 31 May 2011 - 17:17 |
| Google AdSense | 20 | 383.32 KB | 31 May 2011 - 06:35 |
| MSIECrawler | 9+10 | 1.57 MB | 30 May 2011 - 10:15 |
| WebCollage | 13 | 1.30 MB | 31 May 2011 - 23:21 |
| Y!J Yahoo Japan | 10+1 | 17.19 KB | 31 May 2011 - 22:46 |
| Voyager | 11 | 375.75 KB | 23 May 2011 - 11:39 |
| W3C Validator | 10 | 15.72 KB | 19 May 2011 - 15:07 |
| NetMechanic | 5+5 | 3.18 KB | 30 May 2011 - 02:14 |
| EasyDL | 9 | 385.67 KB | 28 May 2011 - 08:24 |
| HTMLParser | 8 | 2.35 MB | 06 May 2011 - 03:41 |
| W3C Link Checker | 4+4 | 2.66 KB | 18 May 2011 - 15:57 |
| TITAN | 6 | 139.21 KB | 21 May 2011 - 21:29 |
| Microsoft URL Control | 5 | 271.46 KB | 24 May 2011 - 05:18 |
| SeznamBot | 2+2 | 4.94 KB | 19 May 2011 - 06:07 |
| Zeus Webster Pro | 4 | 16.37 KB | 27 May 2011 - 15:24 |
| BBot | 4 | 5.63 MB | 31 May 2011 - 15:31 |
| LinkChecker | 2+2 | 4.78 KB | 31 May 2011 - 18:21 |
| Cursor | 3 | 70.36 KB | 18 May 2011 - 12:40 |
| Monster | 3 | 55.10 KB | 31 May 2011 - 05:16 |
| Internet Shinchakubin | 2 | 206.31 KB | 21 May 2011 - 17:40 |
| Vagabondo | 1+1 | 28.08 KB | 03 May 2011 - 17:53 |
| W3C jigsaw CSS Validator | 2 | 7.64 KB | 12 May 2011 - 15:13 |
| mnoGoSearch search engine software | 2 | 5.18 KB | 30 May 2011 - 04:57 |
| LinkWalker | 1 | 4.48 KB | 13 May 2011 - 03:32 |
| InternetSeer | 1 | 3.59 KB | 26 May 2011 - 04:13 |
| Susie | 1 | 2.13 KB | 15 May 2011 - 09:21 |
| SpiderMan | 0+1 | 386 Bytes | 06 May 2011 - 18:38 |
| StackRambler | 0+1 | 386 Bytes | 21 May 2011 - 04:17 |
| NG 2.x (Exalead) | 1 | 53.67 KB | 08 May 2011 - 10:15 |
| Web Downloader | 1 | 1.56 MB | 14 May 2011 - 17:12 |
| NG 1.x (Exalead) | 1 | 85.57 KB | 18 May 2011 - 00:14 |
| BlogSearch | 0+1 | 351 Bytes | 20 May 2011 - 14:19 |
| Link Valet Online | 1 | 306 Bytes | 08 May 2011 - 02:07 |
| arks | 1 | 129.66 KB | 22 May 2011 - 19:10 |
| lwp-trivial | 1 | 12.79 KB | 12 May 2011 - 03:38 |
| Perman surfer | 0+1 | 351 Bytes | 02 May 2011 - 09:39 |