Multilingual Serverless XLM RoBERTa with HuggingFace, AWS Lambda

Multilingual Serverless XLM RoBERTa with HuggingFace, AWS Lambda. We are going to use the new AWS Lambda Container Support to build a Question-Answering API with a xlm-roberta. Learn how to build a Multilingual Serverless BERT Question Answering API.

Learn how to build a Multilingual Serverless BERT Question Answering API with a model size of more than 2GB and then testing it in German and France

Introduction

Currently, we have 7.5 billion people living on the world in around 200 nations. Only  1.2 billion people of them are native English speakers. This leads to a lot of unstructured non-English textual data.

Most of the tutorials and blog posts demonstrate how to build text classification, sentiment analysis, question-answering, or text generation models with BERT based architectures in English. In order to overcome this missing, we are going to build a multilingual Serverless Question Answering API.

Multilingual models describe machine learning models that can understand different languages. An example of a multilingual model is  mBERT from Google research.  This model supports and understands 104 languages.

We are going to use the new AWS Lambda Container Support to build a Question-Answering API with a xlm-roberta. Therefore we use the  Transformers library by HuggingFace, the  Serverless Framework, AWS Lambda, and Amazon ECR.

The special characteristic about this architecture is that we provide a “State-of-the-Art” model with more than 2GB and that is served in a Serverless Environment

Before we start I wanted to encourage you to read my blog  philschmid.de where I have already wrote several blog posts about Serverless, how to deploy  BERT in a Serverless Environment, or  How to fine-tune BERT models.

You can find the complete code for it in this  Github repository.

bert machine-learning aws serverless

We supply you with world class machine learning experts / ML Developers with years of domain experience who can add more value to your business.

We supply you with world class machine learning experts / ML Developers with years of domain experience who can add more value to your business.

We supply you with world class machine learning experts / ML Developers with years of domain experience who can add more value to your business.

Build a serverless question-answering API with BERT, HuggingFace, the Serverless Framework, and AWS Lambda.

What is neuron analysis of a machine? Learn machine learning by designing Robotics algorithm. Click here for best machine learning course models with AI