TL;DR; GPT-3 will not take your programming job (Unless you are a terrible programmer, in which case you would have lost your job anyway)

Once again the hype of artificial intelligence has broken in the news. This

time under the name of GPT-3, the successor of GPT-2 (of course), a

model that is so large and so powerful that is making people think we

finally made AGI, artificial general intelligence, possible (AGI is the

kind of stuff that charlatans like Ben Goertzel keep claiming since a

decade already).

For those who are new to the topic, GPT-2 was a model in the NLP (Natural Language Processing) field of research that can generate text from an input sample. Basically, given a bunch of words or a structured sentence in English or another language, it will continue generating text that is consistent with the input. Such an impressive result! Such an amazing artificial intelligence!

However, the way such a model is trained is not magic nor mysterious at all. Let me be clear on this: it is not magic nor mysterious. In fact, it is

very simple. Given a bunch of words, the model is asked to predict the

next word that makes the most sense in that particular context. That is

it. An old good statistician would do this with a Markov process or

other probabilistic approaches that could lead to similar results. GPT-3

does this with 175 billion parameters (yep, no typos). The input text

is nothing more than whatever is publically available from the Internet:

discussion forums, Reddit threads, digitized books, websites,

Wikipedia, you name it.

How can one use GPT-3?

Using GPT-3 is very simple (provided one has a really really fat machine

packed with GPUs). It can be done in three easy steps, given the trained

model (that would cost you several thousand dollars):

1. provide a description of the task e.g. “translate English to french”

2. provide an example (optional) eg. the chair => la chaise

3. provide an “unseen” case e.g. the table =>…

and GPT-3 will magically make a translation for you because you know, that’s what artificial intelligence can do.

#gpt-3 #artificial-intelligence #machine-learning #nlp #natural-language-processing #latest-tech-stories #hackernoon-top-story #what-is-gpt-3