Get to know your friends with Natural Language Processing (NLP)

Get to know your friends with Natural Language Processing (NLP)

Prepare, explore and understand user habits using NLP and Plotly. Doing a new project and having a good idea can be challenging. During the last months, amidst the strange situation, we are all in, I did not know what project to do.

Doing a new project and having a good idea can be challenging. During the last months, amidst the strange situation, we are all in, I did not know what project to do. I started a few projects but I did not finish them because the results were not promising and not worthy of an article. I knew that I did not want to use a Data Set on Kaggle or elsewhere, but I wanted to do an end-to-end project by using data that I would need to collect.

After browsing through articles/projects on Medium, thanks to the article of Samir Sheriff, I found out that it is possible to analyze data from a WhatsApp Group, and as I have not done a project on Natural Language Processing or NLP, I thought this was a great opportunity to sharpen my technical skills.

Build your own Whatsapp Chat Analyzer

A step-by-step guide using Python

towardsdatascience.com

What is Natural Language Processing?

Natural language is used for everyday communication between humans, such as Messenger, e-mails, Whatsapp, social media (Twitter, Facebook, etc.). The data from these sources are highly unstructured for both text and speech, thus making it difficult to parse and comprehend by machines. Natural language processing (NLP) is concerned with the interaction between natural human language and computers. It is an intersection among the fields of linguistics, computer science, and artificial intelligence.

Nowadays, most of the data are classified as unstructured data, meaning that the data collected are not organized in tables, like in Microsoft Excel. It is, therefore, more difficult to analyze and not easily searchable, which is why it was not useful for organizations until recent years. It often requires a lot of time to clean and organize the data into a useful data frame, which is for many people a boring task. If this information is ignored, companies aren’t using everything available to them to be successful. Right now in the job market, more and more companies are looking for a specialist to analyze these data as they want to leverage this precious information. I did a similar article in the past about how to collect and process tweets to an Amazon S3 bucket.

How to Extract Data from Twitter through Cloud Computing

By using Python and Tweepy

medium.com

Artificial intelligence algorithms now help to automatically extract meaning from the volumes of unstructured data that are generated daily. Companies use big data tools and software such as Hadoop to prepare, mine, integrate, store, track, index, and report business insights from raw unstructured data.

I have summarized the main application of NLP below:

  • Classification: Classify documents based on the content, this technology is used for a spam filter in the email box or to analyze the reviews on a product.
  • Recommendation: selects themost relevant document based on the given information via a content-based on an algorithm. This technology is used by Google, Netflix, Amazon to recommend something based on your previous searches.
  • Topic Modelling: Understand the meaning of a text by interpreting patterns and identify a structure behind each individual.

data-science nlp whatsapp python programming

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

Data Science With Python Training | Python Data Science Course | Intellipaat

🔵 Intellipaat Data Science with Python course: https://intellipaat.com/python-for-data-science-training/In this Data Science With Python Training video, you...

Python for Data Science | Data Science With Python | Python Data Science Tutorial

🔥Intellipaat Python for Data Science Course: https://intellipaat.com/python-for-data-science-training/In this python for data science video you will learn e...

Applied Data Science with Python Certification Training Course -IgmGuru

Master Applied Data Science with Python and get noticed by the top Hiring Companies with IgmGuru's Data Science with Python Certification Program. Enroll Now

NLP For WhatsApp Chats | Data Science | Machine Learning | Python

In this article, I will use NLP to analyze my WhatsApp Chats. For NLP of WhatsApp chats, you need to extract the whatsapp chats from your smartphone.

Data Science Course in Dallas

Become a data analysis expert using the R programming language in this [data science](https://360digitmg.com/usa/data-science-using-python-and-r-programming-in-dallas "data science") certification training in Dallas, TX. You will master data...