Scrapy is one of the popular Python frameworks used for web scraping. For the purpose of this tutorial, I wanted to use a website I am familiar with. I previously did a project on classifying hit records using entries on the Billboard Hot 100 charts as ground truth. I used a python wrapper at the time which was effective in obtaining my dataset. However, I wanted to show that this could have easily been done using Scrapy.

#scrapy #web-crawler #data-science #python3 #web-scraping