Generalised Linear Models — Basics and Implementation. Some of the basic linear regression and classification algorithms can also be derived from the general form of Exponential Family.

Probability distributions are fundamental to statistics, just like data structures are to computer science.

Things happen all the time:

1) dice are rolled,

2) it rains,

3) buses arrive.

After the fact, the specific outcomes are certain:

- the dice came up 3 and 4,
- there was half an inch of rain today,
- the bus took 3 minutes to arrive.

Probability distributions describe what we think the probability of each outcome is, which is sometimes more interesting to know than simply which single outcome is most likely.

They come in many shapes, but in only one size: probabilities in a distribution always add up to **1**.

**For example**, flipping a fair coin has two outcomes: it lands heads or tails.

Before the flip, we believe there’s a 1 in 2 chance, or 0.5 probability, of heads. The same is true for tails.

That’s a probability distribution over the two outcomes of the flip, and this is an example of **Bernoulli distribution.**

Above, both outcomes were equally likely, and that’s what’s illustrated in the diagram. The Bernoulli PDF has two lines of equal height, representing the two equally-probable outcomes of 0 and 1 at either end.

Some of the basic linear regression and classification algorithms can also be derived from the general form of Exponential Family.

A distribution belongs to exponential family if it can be transformed into the general form:

where

**η** is canonical parameter

**T(x)** is sufficient statistic

**A(η)** is cumulant function or log partition function

Exponential family includes the **Gaussian, binomial, multinomial, Poisson, Gamma** and many others distributions.

A fixed choice of T, a and h defines a family (or set) of distributions that is parameterized by η; as we vary η, we then get different distributions within this family.

Some examples of Exponential Family Distributions used in Machine learning

1) Bernoulli Distribution

2) Gaussian Distribution

etc..

machine-learning linear-models glm artificial-intelligence basics-machine-learning

Enroll now at CETPA, the best Institute in India for Artificial Intelligence Online Training Course and Certification for students & working professionals & avail 50% instant discount.

What is Artificial Intelligence (AI)? AI is the ability of a machine to think like human, learn and perform tasks like a human. Know the future of AI, Examples of AI and who provides the course of Artificial Intelligence?

Artificial Intelligence (AI) will and is currently taking over an important role in our lives — not necessarily through intelligent robots.

You got intrigued by the machine learning world and wanted to get started as soon as possible, read all the articles, watched all the videos, but still isn’t sure about where to start, welcome to the club.

We supply you with world class machine learning experts / ML Developers with years of domain experience who can add more value to your business.