30-Second Summary

• Any innovative AI technology has its share of advantages and threats. GPT-3 is not an exception.
• GPT-3 will not be limited by it size and its cost will probably decrease quickly over time. The problem of energy consumption remains a challenge for researchers.
• GPT-3 has been quick to impress us, it was also quick to demonstrate algorithmic biases. It seeming to jump over Turing Test-style hurdles but it does not understanding the why. It makes simple errors no human would ever make.
• The next generations of AI will be able to take over all analytical and repetitive tasks but they will not replace humans. This is always what happens when new technology is introduced. Some jobs get replaced, but new jobs are introduced.
• GPT-3 could brings us one step closer to the future possibility of highly sophisticated Artificial General Intelligence.

Open questions

GPT-3 is not intelligent like a human. It does not know the meaning of words! It knows the likelihood of a word following another. GPT-3 is powerful because it does one thing and it does right, predict the next word. This is why it is very good at solving other tasks, ordering the letters of a word, arithmetics, translation for which it has never been trained. But these functions are not contained in the training corpus. These are emerging properties. This technology is made up of three components.

Open and big data + computational resources (supercomputers) + Machine learning models

GPT-3 is not a super-intelligence or a human-like AI that transhumanists blindly claim. But OpenAI has created a breakthrough. The advance is significant enough to open up real questions.

#gpt-3 #ai #artificial-intelligence #machine-learning #technology