When normalization was introduced in deep learning, it was the next big thing and improved performances considerably. Getting it right can be a crucial factor for your model. Ever had those questions whatever the hell is batch normalization and how does it improve performances. Also are there any substitutes for it? If you like me had these questions but never bothered and just used it for the sake of it in your models this article will clear it up.

Table of Contents

• Batch Normalization
• Group Normalization
• Instance Normalization
• Layer Normalization
• Weight Normalization
• Implementation in Tensorflow

#artificial-intelligence #data-science #deep-learning #machine-learning #tensorflow