It’s become rather difficult to scrape some of the larger tech websites, such as LinkedIn. Likely due to the amount of personal information at stake. But I’m here to mess up everything they worked so hard to prevent. Also, For the record, this is for educational purposes only.

Setup Steps

• Libraries
• Soup Objects
• CSRF Tokens
• Login Request and HTML
• Potentially add more pages
• Scraping Metadata for Each Column
• Create and Append Columns to DataFrame

#pandas #web-scraping #python #linkedin