In this videos we’ll discuss the benefits of using Mechanical Soup over Beautiful Soup for web scraping, and show a few handy examples in code.
The end result of this tutorial would be a local database of cat and dog photos, created from scratch in LESS THAN 10 MINUTES!
We’ll completely automate the process of searching for images on Google, downloading them and saving them to a new local directory. We’ll scrap the HTML code from a few web pages at a time and create a very efficient searching process for any desired term.
Well need the help of mechanicalsoup, os and wget modules to achieve these results, and a basic level of Python knowledge is recommended for the viewer.

Mechanical Soup Documentation:
https://mechanicalsoup.readthedocs.io/en/stable/

Check out the code on Github:
https://github.com/MariyaSha/BetterWebScraping

#python

Better Web Scraping with Mechanical Soup - Build a Database of Cat and Dog Photos
11.20 GEEK