Internet Data Mining

wss-graph Total Sites Across All Domains (logarithmic scale)

Netcraft has explored the internet since 1995 and is a respected authority on the market share of web servers, operating systems, hosting providers, ISPs, encrypted transactions, electronic commerce, scripting languages and content technologies on the internet. By surveying the web, collecting and collating as many hostnames providing an HTTP service as we can find, and systematically polling each one with an HTTP request for the server name, we are able to create datasets that give a clear picture of what is happening on the internet.

Customers include: British Telecom, Cisco, cPanel, Datapipe, DigitalOcean, GoDaddy, Host Europe, Intel, Iomart, Microsoft, OVH, Parallels, Peer1, Rackspace, IBM/Softlayer, Symantec, United Internet and a range of investment and venture capital organisations.

Paid attention to #Netcraft server counts, knew #Amazon were to unveil size of #AWS. Bought in at $389, 1 day later:

– Ian Waring (@ianwaring) April, 2015

Cool stats on our latest investment Digital Ocean— taking web infrastructure market by storm—

- Marc Andreessen (@pmarca) March, 2014