WWW Statistics for Netlib  

Statistics for:  www.netlib.org Last Update:  23 Jan 2012 - 16:59 Reported period: Year 2011

Close window

 

Robots/Spiders visitors

155 different robots Hits Bandwidth Last visit Unknown robot (identified by 'crawl') 4,475,940+15675 86.60 GB 31 Dec 2011 - 20:45 Googlebot 3,498,910+3901 905.30 GB 31 Dec 2011 - 21:06 Yahoo Slurp 3,048,406+7571 267.09 GB 31 Dec 2011 - 20:21 WGet tools 1,576,686+747 314.86 GB 31 Dec 2011 - 20:43 Unknown robot (identified by 'robot') 1,556,196+3273 120.95 GB 31 Dec 2011 - 21:06 BaiDuSpider 1,461,571+4610 424.60 GB 31 Dec 2011 - 21:06 Yandex bot 1,425,522+2328 49.70 GB 31 Dec 2011 - 21:06 Unknown robot (identified by 'bot*') 1,123,462+71165 225.26 GB 31 Dec 2011 - 21:05 HTTrack off-line browser 816,497+288 40.11 GB 31 Dec 2011 - 14:33 Voila 581,227+4961 51.02 GB 31 Dec 2011 - 21:06 MSNBot 500,187+745 181.48 GB 31 Dec 2011 - 15:01 Ocelli 314,679+35 28.67 GB 23 Dec 2011 - 21:34 Perl tool 281,799 170.84 GB 31 Dec 2011 - 20:39 WebVac 256,966+30 38.24 GB 14 Dec 2011 - 08:32 Unknown robot (identified by empty user agent string) 250,556+2159 27.69 GB 31 Dec 2011 - 21:02 Unknown robot (identified by '*bot') 218,062+10348 28.65 GB 31 Dec 2011 - 20:51 MJ12bot 156,968+9825 19.43 GB 31 Dec 2011 - 20:49 Java (Often spam bot) 165,207+132 14.87 GB 31 Dec 2011 - 21:00 Sogou Spider 156,361+370 82.00 GB 31 Dec 2011 - 21:02 Unknown robot (identified by 'discovery') 116,624+11978 21.40 GB 30 Dec 2011 - 11:32 Nutch 96,502+5243 19.33 GB 31 Dec 2011 - 20:11 ichiro 77,424+1031 13.43 GB 30 Dec 2011 - 13:35 Speedy Spider 62,371+12777 10.86 GB 31 Dec 2011 - 21:02 GigaBot 63,057+426 115.64 GB 31 Dec 2011 - 13:20 IlTrovatore-Setaccio 54,662 158.37 GB 31 Dec 2011 - 19:05 BSpider 53,603+993 1.56 GB 31 Dec 2011 - 21:02 MSNBot-media 36,579+17503 2.59 GB 31 Dec 2011 - 20:12 legs 50,689+1656 12.43 GB 22 Dec 2011 - 23:08 Custo 49,278+2621 3.54 GB 26 Dec 2011 - 06:26 Exabot 43,882+1497 2.10 GB 31 Dec 2011 - 20:58 Heritrix 43,564+84 5.74 GB 23 Dec 2011 - 21:42 yacy 40,246+292 4.17 GB 30 Dec 2011 - 17:39 Unknown robot (identified by 'spider') 30,017+5110 7.84 GB 31 Dec 2011 - 20:47 W3C Link Checker 17,406+16567 920.12 MB 31 Dec 2011 - 20:57 Python-urllib 31,559+319 4.76 GB 31 Dec 2011 - 18:16 InfoSeek Robot 1.0 29,773 25.75 GB 29 Dec 2011 - 00:16 archive.org bot 23,778+167 2.85 GB 27 Dec 2011 - 20:51 Unknown robot (identified by hit on 'robots.txt') 0+22991 7.86 MB 31 Dec 2011 - 20:57 psbot 20,377+978 312.32 MB 07 Dec 2011 - 00:37 WebReaper 17,510+31 2.30 GB 19 Dec 2011 - 03:00 bender focused_crawler 12,986+720 1.56 GB 12 Dec 2011 - 00:17 WordPress 11,873+1 4.95 GB 31 Dec 2011 - 03:28 Unknown robot (identified by 'checker') 11,240+5 10.31 GB 31 Dec 2011 - 06:45 Alexa (IA Archiver) 7,439+2901 382.26 MB 31 Dec 2011 - 20:31 Mail.ru bot 9,018+43 3.46 GB 30 Dec 2011 - 23:35 Turn It In 8,815+32 1.15 GB 25 Nov 2011 - 20:26 CFNetwork 8,138 2.22 GB 31 Dec 2011 - 10:20 OutfoxBot/YodaoBot 7,467+588 46.07 MB 31 Dec 2011 - 07:06 Webdup 6,396 51.47 MB 03 Dec 2011 - 12:45 LinkChecker 3,274+1167 33.45 MB 30 Dec 2011 - 04:35 Ask 3,591+502 187.00 MB 11 Dec 2011 - 10:40 FaceBook bot 3,937+23 5.90 GB 31 Dec 2011 - 14:16 Jakarta commons-httpclient 3,814+2 2.81 GB 30 Dec 2011 - 07:16 LinkScan 3,730 358.94 MB 31 Dec 2011 - 08:01 Netluchs 2,890+226 2.13 GB 30 Dec 2011 - 02:50 Unknown robot (identified by 'sucker') 2,921+12 55.54 MB 28 Dec 2011 - 19:06 WWWC Ver 0.2.5 2,730 7.62 KB 28 Dec 2011 - 03:12 larbin 2,322+279 43.99 MB 15 Dec 2011 - 23:15 SeznamBot 1,992+417 121.69 MB 31 Dec 2011 - 05:38 Findlinks 1,449+745 32.08 MB 31 Dec 2011 - 16:55 Powermarks 1,970 517.29 MB 31 Dec 2011 - 20:16 StackRambler 1,783+51 67.45 MB 22 Jun 2011 - 17:35 HTMLParser 1,802 96.08 MB 27 Dec 2011 - 11:37 Checkbot 1,666 0 26 Dec 2011 - 07:29 Y!J Yahoo Japan 713+816 72.64 MB 31 Dec 2011 - 20:44 NG 1.x (Exalead) 1,226 83.05 MB 30 Dec 2011 - 11:03 Google AdSense 1,103+1 643.14 MB 31 Dec 2011 - 20:16 MSIECrawler 728+308 61.68 MB 31 Dec 2011 - 15:40 MojeekBot 616+381 11.29 MB 20 Nov 2011 - 23:58 SuperBot 673 664.01 MB 02 Dec 2011 - 06:04 The web archive (IA Archiver) 3+638 711.90 KB 28 Jun 2011 - 16:44 Motor 547+4 136.63 MB 17 Dec 2011 - 20:28 BBot 404+16 33.97 MB 28 Dec 2011 - 04:29 Feedfetcher-Google 407 8.15 MB 30 Dec 2011 - 12:51 EasyDL 381 32.38 MB 17 Sep 2011 - 05:49 ASPseek 288 2.34 MB 26 May 2011 - 18:03 W3C Validator 242 65.21 MB 30 Dec 2011 - 04:36 Ultraseek 91+150 8.04 MB 26 Dec 2011 - 04:08 Netcraft 165 297.07 KB 30 Dec 2011 - 02:41 BetaBot 116+47 1.98 MB 04 Jul 2011 - 12:03 WebCollage 156 1.03 MB 27 Dec 2011 - 01:58 Fish search 154 58.88 MB 30 Dec 2011 - 04:50 QihooBot 148 2.72 MB 29 Dec 2011 - 19:31 LinkWalker 138+1 1.88 MB 13 Jan 2011 - 19:18 Holmes 34+99 3.34 MB 03 Sep 2011 - 11:40 MagpieRSS 32+78 703.51 KB 31 Dec 2011 - 13:38 Vagabondo 70+32 17.32 MB 26 Dec 2011 - 11:21 Web Core / Roots 94 79.08 MB 18 Dec 2011 - 07:15 Emacs-w3 Search Engine 93 7.69 MB 13 Dec 2011 - 08:41 FeedValidator 75 650.13 KB 26 Sep 2011 - 19:37 VORTEX 71 62.77 MB 15 Dec 2011 - 23:46 Steeler 55+6 4.15 MB 25 May 2011 - 08:06 SurveyBot 30+30 117.89 KB 27 Dec 2011 - 20:47 FavIconizer 57+1 267.06 KB 26 Dec 2011 - 14:46 LinkBot 49 3.95 MB 04 Dec 2011 - 15:51 YahooSeeker Yahoo! Blog crawler 24+24 3.19 MB 26 Jun 2011 - 23:41 Allrati 40 1.65 MB 09 Feb 2011 - 14:09 Susie 40 698.77 KB 20 Dec 2011 - 02:47 arks 33 13.23 KB 26 Dec 2011 - 09:03 Harvest 27+2 142.64 KB 20 Dec 2011 - 15:02 Grub.org 25 240.48 KB 19 Apr 2011 - 18:00 Feedburner 24 0 22 Dec 2011 - 16:20 mnoGoSearch search engine software 17+6 43.61 KB 10 Nov 2011 - 14:51 Unknown robot (identified by 'hunter') 23 1.77 MB 06 Dec 2011 - 19:44 JCrawler 18+4 869.53 KB 26 Jun 2011 - 23:49 Unknown robot (identified by 'scanner') 15+6 90.82 KB 18 Aug 2011 - 00:39 Spiderman 13+7 55.60 MB 04 Jun 2011 - 19:32 lwp-trivial 12+6 1.65 MB 26 Dec 2011 - 02:19 SpiderBot 17+1 61.20 KB 02 Dec 2011 - 16:01 MOMspider 0+17 5.96 KB 18 Dec 2011 - 22:59 IBM Almaden Research Center WebFountain™ 10+7 34.85 MB 15 Oct 2011 - 22:10 Crawl libcrawl 10+6 258.46 KB 19 Mar 2011 - 18:36 lwp-request 15 3.05 MB 20 Oct 2011 - 18:09 Sleek 15 0 15 Dec 2011 - 14:44 JBot Java Web Robot 14 1.26 MB 25 Dec 2011 - 02:54 Ezresult 13 3.40 MB 09 Mar 2011 - 11:49 Cursor 13 1.29 MB 28 Dec 2011 - 00:30 Sunrise 13 12.87 KB 01 Aug 2011 - 04:04 T-H-U-N-D-E-R-S-T-O-N-E 7+3 910.88 KB 27 Dec 2011 - 15:12 Combine System 4+6 97.38 KB 07 Dec 2011 - 11:03 Phantom 9 85.42 KB 12 Dec 2011 - 05:49 Scooter 9 2.44 MB 05 Mar 2011 - 09:30 churl 8 256.68 KB 29 Oct 2011 - 14:55 Yahoo-MMCrawler 7 2.67 MB 04 Mar 2011 - 12:59 TITAN 7 55.34 MB 16 Nov 2011 - 03:54 ZyBorg 6 474.94 KB 08 Aug 2011 - 01:39 NG 2.x (Exalead) 4+2 134.40 KB 18 Mar 2011 - 10:10 NutchCVS 4+1 14.67 KB 27 Jan 2011 - 09:30 Voyager 5 3.38 MB 27 Nov 2011 - 21:06 Araneo 2+3 5.58 KB 18 Dec 2011 - 13:04 PhpDig 1+4 718 Bytes 10 Nov 2011 - 14:13 Internet Shinchakubin 4 17.10 KB 28 Nov 2011 - 08:56 Zeus Webster Pro 4 8.13 KB 12 Mar 2011 - 16:15 Muncher 4 1.06 MB 24 Sep 2011 - 14:14 MSRBOT 2+2 29.89 KB 13 Sep 2011 - 12:43 InternetSeer 3 84.88 KB 24 Sep 2011 - 21:19 CipinetBot 2+1 12.40 KB 24 Jul 2011 - 07:16 ht://Dig 1+1 3.93 KB 06 Oct 2011 - 21:47 Tarantula 2 42.29 KB 03 Feb 2011 - 23:37 The Web Moose 2 11.19 KB 22 Jun 2011 - 00:28 WallPaper (alias crawlpaper) 2 15.32 KB 08 Nov 2011 - 18:25 Webinator 2 108.22 KB 28 Dec 2011 - 19:02 FeedCrawl by feed@aobo.com 2 11.30 KB 07 Feb 2011 - 18:52 NewsGator Online 1 3.58 KB 18 Feb 2011 - 18:18 WatchMouse Website Monitor 1 3.58 KB 14 Jul 2011 - 11:13 Fast-Webcrawler 1 3.58 KB 14 Feb 2011 - 12:48 UniversalFeedParser 1 11.54 KB 25 Jan 2011 - 09:44 BecomeBot 0+1 359 Bytes 06 Jul 2011 - 12:51 Bookmark-Manager 1 0 04 Jan 2011 - 11:58 DeWeb(c) Katalog/Index 1 3.72 KB 12 Jan 2011 - 16:07 UdmSearch 1 20.19 KB 17 Mar 2011 - 01:46 Digger 1 1.11 KB 12 Mar 2011 - 12:14 Pioneer 1 34.94 KB 08 Jul 2011 - 01:31 Gulper Bot 1 45.16 KB 29 Sep 2011 - 19:46 Feedster 1 3.58 KB 16 Jan 2011 - 14:03 Others 0 0

* Robots shown here gave hits or traffic "not viewed" by visitors, so they are not included in other charts. Numbers after + are successful hits on "robots.txt" files.



Advanced Web Statistics 7.0 (build 1.971) - Created by awstats (plugins: hashfiles, decodeutfkeys)