A Gentle Introduction to Ensemble Learning

A Gentle Introduction to Ensemble Learning

In this post, you will discover a gentle introduction to ensemble learning.

Many decisions we make in life are based on the opinions of multiple other people.

This includes choosing a book to read based on reviews, choosing a course of action based on the advice of multiple medical doctors, and determining guilt.

Often, decision making by a group of individuals results in a better outcome than a decision made by any one member of the group. This is generally referred to as the wisdom of the crowd.

We can achieve a similar result by combining the predictions of multiple machine learning models for regression and classification predictive modeling problems. This is referred to generally as ensemble machine learning, or simply ensemble learning.

In this post, you will discover a gentle introduction to ensemble learning.

After reading this post, you will know:

  • Many decisions we make involve the opinions or votes of other people.
  • The ability of groups of people to make better decisions than individuals is called the wisdom of the crowd.
  • Ensemble machine learning involves combining predictions from multiple skillful models.

Let’s get started.


This tutorial is divided into three parts; they are:

  1. Making Important Decisions
  2. Wisdom of Crowds
  3. Ensemble Machine Learning

Making Important Decisions

Consider important decisions you make in your life.

For example:

  • What book to purchase and read next.
  • What university to attend.

Candidate books are those that sound interesting, but the book we purchase might have the most favorable reviews. Candidate universities are those that offer the courses we’re interested in, but we might choose one based on the feedback from friends and acquaintances that have first-hand experience.

We might trust the reviews and star ratings because each individual that contributed a review was (hopefully) unaffiliated with the book and independent of the other people leaving a review. When this is not the case, trust in the outcome is questionable and trust in the system is shaken, which is why Amazon works hard to delete fake reviews for books.

Also, consider important decisions we make more personally.

For example, medical treatment for an illness.

We take advice from an expert, but we seek a second, third, and even more opinions to confirm we are taking the best course of action.

The advice from the second and third opinion may or may not match the first opinion, but we weigh it heavily because it is provided dispassionately, objectively, and independently. If the doctors colluded on their opinion, then we would feel like the process of seeking a second and third opinion has failed.

ensemble learning

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

Why Deep Learning Ensembles Outperform Bayesian Neural Networks

Don’t they do the same thing? Why Deep Learning Ensembles Outperform Bayesian Neural Networks

Advanced Ensemble Learning Techniques

In this post I will cover ensemble learning types, advanced ensemble learning methods — Bagging, Boosting, Stacking and Blending with code samples. At the end I will explain some pros and cons of using ensemble learning.

Ensemble Learning And Their Methods

The word Ensemble refers to a group of objects and viewing them as a whole. The same definition applies even for Ensemble modeling in machine learning in which a group of models are considered together to make predictions.

Ensembles: the almost free Lunch in Machine Learning

Ensembles: the almost free Lunch in Machine Learning. Build optimal ensembles of neural networks with PyTorch and NumPy

Learn Transfer Learning for Deep Learning by implementing the project.

Project walk-through on Convolution neural networks using transfer learning. From 2 years of my master’s degree, I found that the best way to learn concepts is by doing the projects.