In this article, we analyze what the data can tell us about creating high performance web sites. Let's see We Rendered A Million Web Pages to Find Out What Makes The Web Slow.
We rendered the top 1 million pages on the web, tracking every conceivable performance metric, logging every error, noting every requested URL. To our knowledge, this produces the first dataset that connects performance, errors, and library use on the web. In this article, we analyze what the data can tell us about creating high performance web sites.
Can you do better than our analysis? We published the dataset to Kaggle, so you can crunch the numbers yourself.
Gathering the data was a matter of writing a bit of code to use Puppeteer to script Chrome, firing up 200 EC2 instances, rendering a million web pages over the weekend, and praying that you’ve actually understood how AWS pricing works.