In this videos we’ll discuss the benefits of using Mechanical Soup over Beautiful Soup for web scraping, and show a few handy examples in code.
The end result of this tutorial would be a local database of cat and dog photos, created from scratch in LESS THAN 10 MINUTES!
We’ll completely automate the process of searching for images on Google, downloading them and saving them to a new local directory. We’ll scrap the HTML code from a few web pages at a time and create a very efficient searching process for any desired term.
Well need the help of mechanicalsoup, os and wget modules to achieve these results, and a basic level of Python knowledge is recommended for the viewer.
Mechanical Soup Documentation:
https://mechanicalsoup.readthedocs.io/en/stable/
Check out the code on Github:
https://github.com/MariyaSha/BetterWebScraping
#python