Introduced in the 1970s, Hopfield networks were popularised by John Hopfield in 1982. Hopfield networks, for the most part of machine learning history, have been sidelined due to their own shortcomings and introduction of superior architectures such as the Transformers (now used in BERT, etc.)

Read more: https://analyticsindiamag.com/modern-hopfield-network-transformers-attention/

#hopfieldnetworks #bert #lstm #machine-learning