| 114 different robots | Hits | Bandwidth | Last visit |
|---|
| Yahoo Slurp | 327789+598 | 22.29 GB | 28 Feb 2009 - 23:59 |
| MSNBot | 289949+1311 | 4.89 GB | 28 Feb 2009 - 23:58 |
| Googlebot | 214530+88 | 6.97 GB | 28 Feb 2009 - 23:59 |
| MLBot | 167307+40 | 1.55 GB | 28 Feb 2009 - 23:59 |
| Unknown robot (identified by 'robot') | 67900+99 | 678.54 MB | 28 Feb 2009 - 23:57 |
| Java (Often spam bot) | 31084+8 | 928.45 MB | 28 Feb 2009 - 23:58 |
| MSNBot-media | 25435+3368 | 3.00 GB | 28 Feb 2009 - 23:45 |
| Nagios | 23604 | 118.72 MB | 28 Feb 2009 - 23:56 |
| Exabot | 14858+31 | 113.02 MB | 27 Feb 2009 - 15:04 |
| Unknown robot (identified by 'crawl') | 12970+490 | 887.96 MB | 28 Feb 2009 - 23:46 |
| Unknown robot (identified by 'spider') | 9760+1501 | 124.04 MB | 28 Feb 2009 - 23:10 |
| psbot | 8544+213 | 462.23 MB | 28 Feb 2009 - 23:46 |
| HTTrack off-line browser | 6958+5 | 2.60 GB | 28 Feb 2009 - 08:40 |
| Voila | 6467+41 | 109.18 MB | 28 Feb 2009 - 23:42 |
| WebVac | 5620+1 | 26.60 MB | 05 Feb 2009 - 16:01 |
| Ask | 5226+168 | 246.62 MB | 28 Feb 2009 - 23:13 |
| Yahoo! Slurp China | 4756+125 | 49.74 MB | 28 Feb 2009 - 23:14 |
| Unknown robot (identified by hit on 'robots.txt') | 0+4568 | 1.71 MB | 28 Feb 2009 - 23:42 |
| Nutch | 4212+132 | 81.09 MB | 28 Feb 2009 - 17:35 |
| BaiDuSpider | 2692+49 | 33.49 MB | 28 Feb 2009 - 23:37 |
| Microsoft URL Control | 2426 | 1.95 GB | 27 Feb 2009 - 06:13 |
| Jakarta commons-httpclient | 1831+30 | 63.89 MB | 28 Feb 2009 - 23:18 |
| Yandex bot | 1820+34 | 35.03 MB | 28 Feb 2009 - 23:02 |
| LiveJournal.com | 1123 | 20.10 MB | 28 Feb 2009 - 23:42 |
| Speedy Spider | 684+289 | 17.27 MB | 27 Feb 2009 - 03:05 |
| Unknown robot (identified by 'bot/' or 'bot-') | 879+90 | 16.89 MB | 28 Feb 2009 - 21:27 |
| ConveraCrawler | 909+22 | 12.36 MB | 12 Feb 2009 - 01:44 |
| MJ12bot | 904+8 | 46.40 MB | 26 Feb 2009 - 20:43 |
| Turn It In | 808+4 | 6.03 MB | 28 Feb 2009 - 22:17 |
| GigaBot | 625+138 | 11.28 MB | 25 Feb 2009 - 08:21 |
| Feedfetcher-Google | 730 | 1.93 MB | 28 Feb 2009 - 23:40 |
| InfoBot | 688+8 | 15.11 MB | 26 Feb 2009 - 09:01 |
| Alexa (IA Archiver) | 600+42 | 22.81 MB | 28 Feb 2009 - 16:27 |
| Grub.org | 574+28 | 10.29 MB | 28 Feb 2009 - 23:25 |
| CFNetwork | 578 | 7.23 GB | 28 Feb 2009 - 19:56 |
| WordPress | 483 | 27.87 MB | 28 Feb 2009 - 21:36 |
| FAST Enterprise Crawler | 401+2 | 5.00 MB | 18 Feb 2009 - 12:01 |
| The web archive (IA Archiver) | 0+387 | 159.13 KB | 27 Feb 2009 - 17:01 |
| Custo | 293+69 | 36.32 MB | 27 Feb 2009 - 11:35 |
| Ocelli | 338+5 | 22.90 MB | 26 Feb 2009 - 00:55 |
| WebCollage | 335 | 29.37 MB | 28 Feb 2009 - 23:39 |
| Python-urllib | 298+19 | 19.74 MB | 28 Feb 2009 - 23:20 |
| TencentTraveler | 262 | 47.46 MB | 28 Feb 2009 - 08:49 |
| MagpieRSS | 245 | 79.29 MB | 20 Feb 2009 - 04:54 |
| VSE | 239+2 | 13.03 MB | 09 Feb 2009 - 16:33 |
| larbin | 159+74 | 26.05 MB | 28 Feb 2009 - 22:49 |
| SpiderMan | 225+5 | 13.30 MB | 28 Feb 2009 - 19:44 |
| Powermarks | 196 | 2.05 MB | 28 Feb 2009 - 21:01 |
| DoCoMo | 178+6 | 4.17 MB | 28 Feb 2009 - 23:46 |
| Gaisbot | 139+18 | 2.72 MB | 27 Feb 2009 - 18:16 |
| Heritrix | 136+15 | 1.92 MB | 28 Feb 2009 - 01:40 |
| MSIECrawler | 115+36 | 17.10 MB | 28 Feb 2009 - 06:14 |
| Asterias | 115 | 2.29 MB | 03 Feb 2009 - 15:07 |
| Yahoo-MMCrawler | 91+4 | 15.04 MB | 28 Feb 2009 - 16:52 |
| Robozilla | 93 | 425.68 KB | 13 Feb 2009 - 22:16 |
| NewsGator Online | 89 | 0 | 28 Feb 2009 - 12:03 |
| Voyager | 76+12 | 1.11 MB | 26 Feb 2009 - 07:35 |
| UP.Browser | 74 | 21.27 MB | 28 Feb 2009 - 12:27 |
| yacy | 53+19 | 13.03 MB | 27 Feb 2009 - 22:14 |
| lwp-request | 58 | 83.21 KB | 28 Feb 2009 - 21:28 |
| BlogPulse ISSpider intelliseek.com | 37+19 | 1.67 MB | 22 Feb 2009 - 22:08 |
| BSpider | 17+37 | 234.68 KB | 28 Feb 2009 - 21:14 |
| LinkWalker | 33+15 | 152.27 KB | 26 Feb 2009 - 05:08 |
| BBot | 44+3 | 6.22 MB | 28 Feb 2009 - 23:58 |
| Fish search | 36 | 694.90 KB | 27 Feb 2009 - 22:28 |
| Checkbot | 35 | 166.09 KB | 28 Feb 2009 - 03:21 |
| Holmes | 15+16 | 6.06 MB | 28 Feb 2009 - 09:46 |
| Google AdSense | 31 | 1.15 MB | 28 Feb 2009 - 23:08 |
| Xenu Link Sleuth | 28 | 30.55 KB | 28 Feb 2009 - 17:43 |
| Motor | 27 | 1.04 MB | 27 Feb 2009 - 14:47 |
| StackRambler | 25+2 | 653.55 KB | 23 Feb 2009 - 06:48 |
| Vagabondo | 15+9 | 2.00 MB | 25 Feb 2009 - 15:17 |
| BlogSearch | 24 | 854.65 KB | 28 Feb 2009 - 17:04 |
| Web Downloader | 23 | 173.74 KB | 07 Feb 2009 - 05:39 |
| Netcraft | 22 | 91.84 KB | 26 Feb 2009 - 07:07 |
| Webdup | 20 | 804.84 KB | 08 Feb 2009 - 03:11 |
| Scooter | 0+20 | 7.54 KB | 28 Feb 2009 - 14:48 |
| lmspider | 8+12 | 437.64 KB | 26 Feb 2009 - 10:09 |
| EasyDL | 19 | 1.33 MB | 25 Feb 2009 - 14:07 |
| HTMLParser | 19 | 318.25 KB | 13 Feb 2009 - 04:28 |
| Snappy | 16 | 146.98 KB | 21 Feb 2009 - 20:12 |
| SurveyBot | 8+8 | 105.17 KB | 25 Feb 2009 - 06:59 |
| Pioneer | 12 | 96.34 KB | 04 Feb 2009 - 18:26 |
| W3C Validator | 11 | 33.07 KB | 23 Feb 2009 - 22:48 |
| Web Core / Roots | 11 | 5.61 MB | 28 Feb 2009 - 16:23 |
| Y!J Yahoo Japan | 10+1 | 591.25 KB | 27 Feb 2009 - 18:46 |
| Walhello appie | 7+3 | 36.53 KB | 28 Feb 2009 - 06:05 |
| W3C jigsaw CSS Validator | 9 | 51.13 KB | 23 Feb 2009 - 22:48 |
| mnoGoSearch search engine software | 8+1 | 167.60 KB | 18 Feb 2009 - 19:02 |
| Emacs-w3 Search Engine | 8 | 3.05 MB | 09 Feb 2009 - 22:38 |
| Cursor | 7 | 238.04 KB | 28 Feb 2009 - 12:57 |
| NG 2.x (Exalead) | 0+7 | 11.47 KB | 18 Feb 2009 - 18:42 |
| NutchCVS | 7 | 59.77 KB | 05 Feb 2009 - 15:38 |
| MojeekBot | 6+1 | 866.68 KB | 17 Feb 2009 - 20:36 |
| lwp-trivial | 7 | 947.99 KB | 25 Feb 2009 - 21:48 |
| FavOrg | 6 | 198.54 KB | 22 Feb 2009 - 10:22 |
| Girafabot | 0+6 | 2.26 KB | 26 Feb 2009 - 03:05 |
| IBM Almaden Research Center WebFountain™ | 4+2 | 85.40 KB | 19 Feb 2009 - 16:36 |
| Digger | 3+1 | 11.13 KB | 20 Feb 2009 - 20:31 |
| Internet Shinchakubin | 4 | 679.15 KB | 21 Feb 2009 - 07:36 |
| Combine System | 2+2 | 2.90 KB | 09 Feb 2009 - 08:40 |
| The World Wide Web Worm | 3 | 380.72 KB | 08 Feb 2009 - 19:20 |
| LinkChecker | 2+1 | 17.31 KB | 24 Feb 2009 - 13:50 |
| TITAN | 3 | 443.33 KB | 03 Feb 2009 - 11:25 |
| ichiro | 2 | 2.06 KB | 01 Feb 2009 - 17:44 |
| W3C Link Checker | 2 | 324 Bytes | 19 Feb 2009 - 09:40 |
| arks | 2 | 2.08 MB | 23 Feb 2009 - 07:08 |
| SuperBot | 1 | 77.61 KB | 04 Feb 2009 - 06:29 |
| Seekbot | 1 | 9.19 KB | 11 Feb 2009 - 10:09 |
| Feedburner | 1 | 341 Bytes | 11 Feb 2009 - 11:07 |
| Bloglines | 1 | 7.71 KB | 08 Feb 2009 - 06:42 |
| YahooSeeker Yahoo! Blog crawler | 0+1 | 386 Bytes | 11 Feb 2009 - 22:06 |
| Sunrise | 1 | 34.82 KB | 13 Feb 2009 - 09:20 |
| Steeler | 1 | 0 | 05 Feb 2009 - 06:32 |