Hadoop Namenode Override issue

Hadoop Namenode Override issue

Recently, I worked on setting up hadoop cluster on two nodes. I developed a bash script to automate this hadoop installation on both master and slave machines.

Recently, I worked on setting up hadoop cluster on two nodes. I developed a bash script to automate this hadoop installation on both master and slave machines. The script will do all the required steps and will configure all the files (core-site.xml, hdfs-site.xml, mapred-site.xml, yarn-site.xml etc..,) appropriately.

I ran that Installer script and everything worked fine. Hadoop cluster with two datanodes is settled up.

Next day, due to my mistake I messed up everything. What I did is , I ran the same Installer script again on the Namenode machine which in turn overrides all the configuration setup and everything on master node. Even namenode got formatted. Luckily, I don’t have any data in that cluster so no issues.

After it got overridden, I tried to start all the hadoop services again on all the nodes using this command:

$HOME/hadoop/sbin/start-all.sh

Verified with below command to check whether it started all the services in namenode or not :

jps

Image for post

namenode running services

When I checked in datanode, datanode service was not started instead only nodemanager service is running:

Image for post

datanodes name-node hadoop hadoop-cluster big-data data analysis

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

Why should you choose Online Big Data Hadoop Training to succeed?

Big Data Hadoop online training Course is one of the best options for the capable and qualified big data experts to boost their career in the industry.

What is the cost of Hadoop Training in India?

It provides huge storage for any form of facts, enormous processing power and the capacity to deal with without a doubt countless concurrent duties or jobs.

Top Microsoft big data solutions Companies | Best Microsoft big data Developers

An extensively researched list of top microsoft big data analytics and solution with ratings & reviews to help find the best Microsoft big data solutions development companies around the world.

Role of Big Data in Healthcare - DZone Big Data

In this article, see the role of big data in healthcare and look at the new healthcare dynamics. Big Data is creating a revolution in healthcare, providing better outcomes while eliminating fraud and abuse, which contributes to a large percentage of healthcare costs.

Silly mistakes that can cost ‘Big’ in Big Data Analytics

‘Data is the new science. Big Data holds the key answers’ - Pat Gelsinger The biggest advantage that the enhancement of modern technology has brought