| 66 different robots | Hits | Bandwidth | Last visit |
|---|
| MSNBot | 663706 | 26.95 GB | 31 Jan 2010 - 23:59 |
| Load Balancing Server | 513823 | 2.69 GB | 31 Jan 2010 - 23:59 |
| Googlebot | 444431 | 152.08 GB | 31 Jan 2010 - 23:59 |
| Unknown robot (identified by 'robot') | 116929 | 4.06 GB | 31 Jan 2010 - 23:58 |
| MLBot | 83937 | 618.63 MB | 31 Jan 2010 - 23:59 |
| Yahoo Slurp | 80124 | 43.98 GB | 31 Jan 2010 - 23:59 |
| Unknown robot (identified by 'crawl') | 36488 | 1017.86 MB | 31 Jan 2010 - 23:52 |
| Exabot | 15515 | 160.66 MB | 31 Jan 2010 - 16:27 |
| Java (Often spam bot) | 12845 | 1.98 GB | 31 Jan 2010 - 22:37 |
| FAST Enterprise Crawler | 10121 | 191.28 MB | 25 Jan 2010 - 00:41 |
| Nagios | 8264 | 97.94 MB | 31 Jan 2010 - 23:56 |
| Yandex bot | 6396 | 228.75 MB | 31 Jan 2010 - 23:08 |
| BaiDuSpider | 2203 | 50.93 MB | 31 Jan 2010 - 23:36 |
| Unknown robot (identified by 'bot/' or 'bot-') | 1931 | 238.39 MB | 31 Jan 2010 - 15:45 |
| Unknown robot (identified by 'spider') | 1098 | 63.08 MB | 31 Jan 2010 - 23:01 |
| HTTrack off-line browser | 1086 | 139.61 MB | 31 Jan 2010 - 13:14 |
| MJ12bot | 1054 | 29.58 MB | 30 Jan 2010 - 23:39 |
| Speedy Spider | 875 | 9.27 MB | 31 Jan 2010 - 23:38 |
| Python-urllib | 819 | 244.28 MB | 31 Jan 2010 - 12:05 |
| Ask | 550 | 133.98 MB | 31 Jan 2010 - 23:39 |
| LiveJournal.com | 424 | 16.16 MB | 31 Jan 2010 - 23:31 |
| Turn It In | 387 | 12.35 MB | 31 Jan 2010 - 23:58 |
| MSNBot-media | 271 | 17.34 MB | 31 Jan 2010 - 13:53 |
| Voila | 186 | 10.39 MB | 29 Jan 2010 - 09:46 |
| yacy | 182 | 18.70 MB | 29 Jan 2010 - 16:19 |
| Alexa (IA Archiver) | 135 | 42.47 MB | 31 Jan 2010 - 07:17 |
| CFNetwork | 119 | 704.65 MB | 31 Jan 2010 - 14:27 |
| Nutch | 97 | 7.37 MB | 28 Jan 2010 - 17:32 |
| Web Core / Roots | 74 | 105.38 MB | 31 Jan 2010 - 13:23 |
| Jakarta commons-httpclient | 58 | 41.95 MB | 31 Jan 2010 - 22:10 |
| Custo | 55 | 1.36 GB | 31 Jan 2010 - 16:19 |
| Voyager | 41 | 441.99 KB | 23 Jan 2010 - 13:49 |
| Microsoft URL Control | 27 | 8.80 MB | 31 Jan 2010 - 06:43 |
| Netcraft | 27 | 93.88 KB | 20 Jan 2010 - 10:18 |
| SpiderMan | 24 | 783.47 KB | 31 Jan 2010 - 02:54 |
| UP.Browser | 22 | 23.88 MB | 31 Jan 2010 - 04:03 |
| legs | 19 | 1.76 MB | 22 Jan 2010 - 20:53 |
| TencentTraveler | 17 | 7.56 MB | 23 Jan 2010 - 00:07 |
| SuperBot | 14 | 31.50 KB | 23 Jan 2010 - 09:28 |
| arks | 13 | 38.07 KB | 21 Jan 2010 - 23:55 |
| Yahoo! Slurp China | 11 | 58.70 KB | 30 Jan 2010 - 18:49 |
| larbin | 11 | 184.54 KB | 29 Jan 2010 - 15:15 |
| WebCollage | 10 | 504.63 KB | 05 Jan 2010 - 04:40 |
| Fish search | 9 | 2.31 MB | 30 Jan 2010 - 11:32 |
| BSpider | 8 | 6.25 MB | 30 Jan 2010 - 15:34 |
| MSIECrawler | 7 | 24.60 KB | 30 Jan 2010 - 08:46 |
| Xenu Link Sleuth | 6 | 1.30 KB | 27 Jan 2010 - 23:43 |
| ruffle SemanticWeb crawler | 6 | 76.33 KB | 18 Jan 2010 - 15:30 |
| SurveyBot | 3 | 33.65 KB | 24 Jan 2010 - 11:21 |
| Heritrix | 3 | 2.87 MB | 15 Jan 2010 - 19:17 |
| DoCoMo | 2 | 41.45 KB | 30 Jan 2010 - 17:52 |
| W3C Validator | 2 | 16.93 KB | 28 Jan 2010 - 11:16 |
| Susie | 2 | 4.26 KB | 25 Jan 2010 - 14:23 |
| Motor | 2 | 1.35 MB | 12 Jan 2010 - 01:52 |
| WordPress | 2 | 640 Bytes | 06 Jan 2010 - 04:47 |
| Muncher | 2 | 1.09 KB | 19 Jan 2010 - 22:53 |
| VSE | 2 | 1.85 MB | 10 Jan 2010 - 14:13 |
| VORTEX | 2 | 22.41 KB | 10 Jan 2010 - 07:43 |
| psbot | 1 | 0 | 12 Jan 2010 - 12:25 |
| Cursor | 1 | 47.13 KB | 24 Jan 2010 - 12:50 |
| Findlinks | 1 | 9.95 KB | 22 Jan 2010 - 01:17 |
| Feedburner | 1 | 351 Bytes | 20 Jan 2010 - 15:03 |
| WallPaper (alias crawlpaper) | 1 | 67.01 KB | 31 Jan 2010 - 12:13 |
| Web Downloader | 1 | 11.21 KB | 31 Jan 2010 - 03:26 |
| YahooSeeker Yahoo! Blog crawler | 1 | 546.54 KB | 04 Jan 2010 - 14:02 |
| HTMLParser | 1 | 701.55 KB | 28 Jan 2010 - 04:26 |