Is Common Sense Common In NLP Models?

Is Common Sense Common In NLP Models? To identify if BERT can solve common sense tasks, researchers discovered how the model computes the structured, common sense knowledge for downstream NLP tasks.

NLP Models have shown tremendous advancements in syntactic, semantic and linguistic knowledge for downstream tasks. However, that raises an interesting research question — is it possible for them to go beyond pattern recognition and apply common sense for word-sense disambiguation?

Thus, to identify if BERT, a large pre-trained NLP model developed by Google, can solve common sense tasks, researchers took a closer look. The researchers from Westlake University and Fudan University, in collaboration with Microsoft Research Asia, discovered how the model computes the structured, common sense knowledge for downstream NLP tasks.

According to the researchers, it has been a long-standing debate as to whether pre-trained language models can solve tasks leveraging only a few shallow clues and their common sense of knowledge. To figure that out, researchers used a CommonsenseQA dataset for BERT to solve multiple-choice problems.

opinions ai common sense bert bert model common sense nlp model nlp models

To identify if BERT can solve common sense tasks, researchers discovered how the model computes the structured, common sense knowledge for downstream NLP tasks.

Researchers at Google AI unveiled an extension of the projection attention neural network PRADO, known as pQRNN.

AI models are influencing how we shop, what we read, how we eat, the clothes we buy, the movies we watch, and more.

Microsoft researchers compiled a comprehensive biomedical NLP benchmark for pre-training biomedical NLP models

Teaching machines to understand human context can be a daunting task. With the current evolving landscape, Natural Language Processing (NLP) has turned out to be an extraordinary breakthrough with its advancements in semantic and linguistic knowledge.NLP is vastly leveraged by businesses to build customised chatbots and voice assistants using its optical character and speed recognition