Using Deep Learning to… Generate Puns?

Using Deep Learning to… Generate Puns?

Using Deep Learning to… Generate Puns? A fun application of state-of-the-art methods in natural language processing that demonstrates how far the field has come.

Natural language processing (NLP) as a field has seen unprecedented growth (especially in the past 2 years due to the publication of BERT). And while much research is focused on tasks with huge implications (e.g., question-answering, text summarization), we should always remember that there are some fun applications of natural language processing research as well. For example, generating puns.

Let’s delve into a recent paper by He et al. that proposes a pretty-strong model for pun generation. P.S. if you just want to see some of the puns that the model ended up generating, I’ve included the puns that the authors give at the end of the post.

The Dataset. First thing’s first. Like any deep learning problem, generating puns obviously requires a not-small dataset. Now, personally I wouldn’t have even thought that a dataset of puns exists. Regardless, the authors found a good collection of puns: the pun dataset from the 2017 SemEval task, which contains 1,099 different puns. Although this is on the small side of datasets, it’s enough to get an acceptably-performing model trained.

Yesterday I swallowed some food coloring. The doctor says I’m OK, but I feel like I dyed a little inside. (“dyed” vs “died”)

machine-learning data-science artificial-intelligence nlp deep-learning

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

Most popular Data Science and Machine Learning courses — July 2020

Most popular Data Science and Machine Learning courses — August 2020. This list was last updated in August 2020 — and will be updated regularly so as to keep it relevant

Artificial Intelligence vs. Machine Learning vs. Deep Learning

Simple explanations of Artificial Intelligence, Machine Learning, and Deep Learning and how they’re all different

Artificial Intelligence, Machine Learning, Deep Learning 

Artificial Intelligence (AI) will and is currently taking over an important role in our lives — not necessarily through intelligent robots.

Data Augmentation in Deep Learning | Data Science | Machine Learning

Data Augmentation is a technique in Deep Learning which helps in adding value to our base dataset by adding the gathered information from various sources to improve the quality of data of an organisation.

Difference between Machine Learning, Data Science, AI, Deep Learning, and Statistics

In this article, I clarify the various roles of the data scientist, and how data science compares and overlaps with related fields such as machine learning, deep learning, AI, statistics, IoT, operations research, and applied mathematics.