The purpose of writing this post is to understand the maths behind gradient descent. Most of us are using gradient descent in machine learning, but we need to understand the maths behind it. As a fresher, when I was learning stochastic gradient descent, I found it a little bit complex. Here, I tried to make it simpler for those who want to know how it works. My focus on this post is to demonstrate the mathematics behind gradient descent.

The purpose of writing this post is to understand the maths behind gradient descent. Most of us are using gradient descent in machine learning, but we need to understand the maths behind it.

As a fresher, when I was learning stochastic gradient descent, I found it a little bit complex. Here, I tried to make it simpler for those who want to know how it works.

My focus on this post is to demonstrate the mathematics behind gradient descent.

Take a quick refresher on what is gradient descent?

Gradient Descent: It is an optimization technique that is used to find coefficients of a function that minimizes an output error.

**Gradient Descent Procedure:**

- Initialize the values for the coefficients (It could be 0.0 or small random value)
- Calculate the cost function by substituting coefficients to the function
- Calculate the partial derivative of the total error with respect to weight
- Update the values of the coefficients
- Repeat the above procedure until we get cost 0.0 or no further improvements in cost can be achieved

We will see methods of the gradient descent before we jump to the implementation of the stochastic gradient descent.

Data Science and Analytics market evolves to adapt to the constantly changing economic and business environments. Our latest survey report suggests that as the overall Data Science and Analytics market evolves to adapt to the constantly changing economic and business environments, data scientists and AI practitioners should be aware of the skills and tools that the broader community is working on. A good grip in these skills will further help data science enthusiasts to get the best jobs that various industries in their data science functions are offering.

We provide an updated list of best online Masters in AI, Analytics, and Data Science, including rankings, tuition, and duration of the education program.

For Big Data Analytics, the challenges faced by businesses are unique and so will be the solution required to help access the full potential of Big Data.

How to Plan and Organize a Data Science/Analytics Project? Conducting a data science/analytics project always takes time and has never been easy.

A data scientist/analyst in the making needs to format and clean data before being able to perform any kind of exploratory data analysis.