When learning Hadoop, one of the biggest challenges I had was to put different components of the Hadoop ecosystem together and create a bigger picture. It’s a huge system which comprises of different components which can be contrasting as well as complementing to each other. Understanding how these different components are interconnected is a must have piece of knowledge for anyone willing to utilize Hadoop based technologies in a production level big data application. Hadoop ecosystem possesses a huge place in the big data technology stack and it’s a must have skill for data engineers. So, let’s dig a little deeper into the world of Hadoop and try to untangle the pieces of which this world is made.

#hdfs #big-data #mapreduce #apache #hadoop