After I got this scrapper working, the number of questions I was answering everyday skyrocketed and, now that you already know the history behind this scraper, let me show you how I made it happen.
First, the code is made to use google Chrome to scrap and Gmail to send the emails. You can, of course, use others, but that’s on you.
We’ll start by importing the libraries we’ll use. You’re probably already familiar with pandas and the sleep function from time. Other than those, we’ll use smtplib to send the emails and selenium, which is an extreme powerful tool, to scrap the website. If you’re into web scraping, selenium
is a must.
#python #q-and-a #selenium #web-scraping