Meme Vision: the science of classifying memes

Meme Vision: the science of classifying memes

Image recognition does not always require neural nets; efficiency and accuracy are achievable with simpler models. As a person of culture and science, I decided to build a model to identify memes.

As a person of culture and science, I decided to build a model to identify memes. This problem is far simpler than the Image-Net competition and so a simpler solution is appropriate. I will demonstrate this by comparing the “Meme Vision” framework to ResNet-50 (the winner of Image-Net 2015).

Method: Meme Vision framework

In a previous article I explained the radial histogram method;

Radial Color Histograms

When color, composition and compute all matter for your computer vision problem — radially reduce the representation…

(TL;DR — it measures the distribution of color in each segment of the image)

Below we see how this can reduce images to very low dimensional representations.

Image for post

Basic radial color histogram example with 3 bins per color channel and 4 segments (giving 4*3³=108 features)

The final Meme Vision model uses a few extra steps:

  • Convert from RGB to HSV - color degradation is less of a problem to computers when viewed in the HSV palette.
  • Log transformation of pixel counts to help focus on the little differences.
  • Use 8 bins per channel (instead of 3) to distinguish similar color shades, which results 2048 features (instead of 108).
  • Feed these features into a linear support vector machine.

image-recognition optimisation neural-networks memes image-classifier neural networks

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

Preprocessing your images for machine learning (image recognition)

During my studies at JKU there was a task for preprocessing images for a machine learning project. It is necessary to clean the raw images…

Satellite image classification with a convolutional neural network.

My latest project at Flatiron was to use neural networks to classify satellite image tiles. I chose to use a convolutional neural network (CNN).

Board Game Image Recognition using Neural Networks

Board Game Image Recognition using Neural Networks. How to use computer vision techniques to identify chess pieces and their location on a chessboard

Convolutional Neural Network (CNN)

It is instructive for instance to trace the computer industry’s to decline in vision, idealism, creativity, romance and sheer fun as it becomes more important and prosperous. Let's look into computational neural network architecture and constructing a cnn model for detection of ship using satellite imagery.

Neural network: what is a neural network?

Neural networks, as their name implies, are computer algorithms modeled after networks of neurons in the human brain. Learn more about neural networks from Algorithmia.