Hadoop Namenode Override issue

Recently, I worked on setting up hadoop cluster on two nodes. I developed a bash script to automate this hadoop installation on both master and slave machines. The script will do all the required steps and will configure all the files (core-site.xml, hdfs-site.xml, mapred-site.xml, yarn-site.xml etc…,) appropriately.

I ran that Installer script and everything worked fine. Hadoop cluster with two datanodes is settled up.

Next day, due to my mistake I messed up everything. What I did is , I ran the same Installer script again on the Namenode machine which in turn overrides all the configuration setup and everything on master node. Even namenode got formatted. Luckily, I don’t have any data in that cluster so no issues.

After it got overridden, I tried to start all the hadoop services again on all the nodes using this command:

$HOME/hadoop/sbin/start-all.sh

Verified with below command to check whether it started all the services in namenode or not :

jps

namenode running services

When I checked in datanode, datanode service was not started instead only nodemanager service is running:

#datanodes #name-node #hadoop #hadoop-cluster #big-data #data analysis

What is GEEK

Buddha Community

Spring: A Static Web Site Generator Written By GitHub Issues

Spring

Spring is a blog engine written by GitHub Issues, or is a simple, static web site generator. No more server and database, you can setup it in free hosting with GitHub Pages as a repository, then post the blogs in the repository Issues.

You can add some labels in your repository Issues as the blog category, and create Issues for writing blog content through Markdown.

Spring has responsive templates, looking good on mobile, tablet, and desktop.Gracefully degrading in older browsers. Compatible with Internet Explorer 10+ and all modern browsers.

Get up and running in seconds.

中文介绍

Quick start guide

For the impatient, here's how to get a Spring blog site up and running.

First of all

• Fork the Spring repository as yours.
• Goto your repository settings page to rename Repository Name.
• Hosted directly on GitHub Pages from your project repository, you can take it as User or organization site or Project site(create a gh-pages branch).
• Also, you can set up a custom domain with Pages.

Secondly

• Open the index.html file to edit the config variables with yours below.

$.extend(spring.config, {
  // my blog title
  title: 'Spring',
  // my blog description
  desc: "A blog engine written by github issues [Fork me on GitHub](https://github.com/zhaoda/spring)",
  // my github username
  owner: 'zhaoda',
  // creator's username
  creator: 'zhaoda',
  // the repository name on github for writting issues
  repo: 'spring',
  // custom page
  pages: [
  ]
})

• Put your domain into the CNAME file if you have.
• Commit your change and push it.

And then

• Goto your repository settings page to turn on the Issues feature.
• Browser this repository's issues page, like this https://github.com/your-username/your-repo-name/issues?state=open.
• Click the New Issue button to just write some content as a new one blog.

Finally

• Browser this repository's GitHub Pages url, like this http://your-username.github.io/your-repo-name, you will see your Spring blog, have a test.
• And you're done!

Custom development

Installation

• You will need a web server installed on your system, for example, Nginx, Apache etc.
• Configure your spring project to your local web server directory.
• Run and browser it, like http://localhost/spring/dev.html .
• dev.html is used to develop, index.html is used to runtime.

Folder Structure

spring/
├── css/
|    ├── boot.less  #import other less files
|    ├── github.less  #github highlight style
|    ├── home.less  #home page style
|    ├── issuelist.less #issue list widget style
|    ├── issues.less #issues page style
|    ├── labels.less #labels page style
|    ├── main.less #commo style
|    ├── markdown.less #markdown format style
|    ├── menu.less #menu panel style
|    ├── normalize.less #normalize style
|    ├── pull2refresh.less #pull2refresh widget style
|    └── side.html  #side panel style
├── dist/
|    ├── main.min.css  #css for runtime
|    └── main.min.js  #js for runtime
├── img/  #some icon, startup images
├── js/
|    ├── lib/  #some js librarys need to use
|    ├── boot.js  #boot
|    ├── home.js  #home page
|    ├── issuelist.js #issue list widget
|    ├── issues.js #issues page
|    ├── labels.js #labels page
|    ├── menu.js #menu panel
|    ├── pull2refresh.less #pull2refresh widget
|    └── side.html  #side panel
├── css/
|    ├── boot.less  #import other less files
|    ├── github.less  #github highlight style
|    ├── home.less  #home page style
|    ├── issuelist.less #issue list widget style
|    ├── issues.less #issues page style
|    ├── labels.less #labels page style
|    ├── main.less #commo style
|    ├── markdown.less #markdown format style
|    ├── menu.less #menu panel style
|    ├── normalize.less #normalize style
|    ├── pull2refresh.less #pull2refresh widget style
|    └── side.html  #side panel style
├── dev.html #used to develop
├── favicon.ico #website icon
├── Gruntfile.js #Grunt task config
├── index.html #used to runtime
└── package.json  #nodejs install config

Customization

• Browser http://localhost/spring/dev.html, enter the development mode.
• Changes you want to modify the source code, like css, js etc.
• Refresh dev.html view change.

Building

• You will need Node.js installed on your system.
• Installation package.

bash

$ npm install

*   Run grunt task.

    ```bash
$ grunt

• Browser http://localhost/spring/index.html, enter the runtime mode.
• If there is no problem, commit and push the code.
• Don't forget to merge master branch into gh-pages branch if you have.
• And you're done! Good luck!

Report a bug

• Check if the bug is already fixed in the master branch since the last release.
• Check existing issues.
• Open a new one, including exact browser & platform information.

Who used

• http://zhaoda.net/spring
• http://zhaoda.net/blog

If you are using, please tell me.

Download Details:
Author: zhaoda
Source Code: https://github.com/zhaoda/spring
License: MIT License

#spring #spring-framework #spring-boot #java 

Hadoop Namenode Override issue

Recently, I worked on setting up hadoop cluster on two nodes. I developed a bash script to automate this hadoop installation on both master and slave machines. The script will do all the required steps and will configure all the files (core-site.xml, hdfs-site.xml, mapred-site.xml, yarn-site.xml etc…,) appropriately.

I ran that Installer script and everything worked fine. Hadoop cluster with two datanodes is settled up.

Next day, due to my mistake I messed up everything. What I did is , I ran the same Installer script again on the Namenode machine which in turn overrides all the configuration setup and everything on master node. Even namenode got formatted. Luckily, I don’t have any data in that cluster so no issues.

After it got overridden, I tried to start all the hadoop services again on all the nodes using this command:

$HOME/hadoop/sbin/start-all.sh

Verified with below command to check whether it started all the services in namenode or not :

jps

namenode running services

When I checked in datanode, datanode service was not started instead only nodemanager service is running:

#datanodes #name-node #hadoop #hadoop-cluster #big-data #data analysis

What is the cost of Hadoop Training in India?

Hadoop is an open-source setting that delivers exceptional data management provisions. It is a framework that assists the processing of vast data sets in a circulated computing habitat. It is built to enhance from single servers to thousands of machines, each delivering computation, and storage. Its distributed file system enables timely data transfer rates among nodes and permits the system to proceed to conduct unbroken in case of a node failure, which minimizes the risk of destructive system downfall, even if a crucial number of nodes become out of action. Hadoop is very helpful for massive scale businesses founding on its proven usefulness for enterprises given below:

Benefits for Enterprises:

● Hadoop delivers a cost-effective storage outcome for a business.
● It promotes businesses to handily access original data sources and tap into numerous categories of data to generate value from that data.
● It is a highly scalable storage setting.
● The distinctive storage procedure of Hadoop is established on a distributed file system that basically ‘maps’ data wherever it is discovered on a cluster. The tools for data processing are often on similar servers where the data is located, occurring in the much faster data processing.
● Hadoop is now widely operated across enterprises, including finance, media and entertainment, government, healthcare, information services, retail, and other commerce
● Hadoop is fault tolerance. When data is delivered to an individual node, that data is also reproduced to other nodes in the cluster, which implies that in the event of loss, there is another copy accessible for usage.
● Hadoop is more than just a rapid, affordable database and analytics device. It is composed of a scale-out architecture that can affordably reserve all of a company’s data for later usage.

Join Big Data Hadoop Training Course to get hands-on experience.

Demand for Hadoop:

Low expense enactment of the Hadoop forum is tempting the corporations to acquire this technology more conveniently. The data management enterprise has widened from software and web into retail, hospitals, government, etc. This builds an enormous need for scalable and cost-effective settings of data storage like Hadoop.
Are you looking for big data analytics training in Noida? KVCH is your go-to institute.

Big Data Hadoop Training Course at KVCH is administered by Experts who provide Online training for big data. KVCH offers Extensive Big Data Hadoop Online Training to learn Big data Hadoop architecture.
At KVCH with the assistance of Big Data Training, make your Big Data Developer Dream Job comes true. KVCH provides Advanced Big Data Hadoop Online Training. Don’t Just Dream to become a Certified Pro Big Data Hadoop Developer achieve it with India’s leading Best Big Data Hadoop Training in Noida.
KVCH’s Advanced Big Data Hadoop Online Training is packed with Best in Industry Certified Professionals who have More than 20+ Big Data Hadoop Industry Experience who Can Provide Real-time Experience As per The Current Industry Needs.

Are you the one who is very passionate to learn Big Data Hadoop Technology from scratch? The one who is eager to understand how this technology functions? Then you’re landed in the right place where you can enhance your skills in this field with KVCH’s Advanced Big Data Hadoop Online Training.
Enroll in Big Data Hadoop Certification Training and receive a Global Certification.
Improve your career progress by discovering the most strenuous technology i.e. Big Data Hadoop Course from the industry-certified experts of Best Big Data Hadoop Online Training. So, choose KVCH the best coaching center and get advanced course complete certification with 100% Job Assistance.

**Why KVCH’s Big Data Hadoop Course should be your choice? **
● Get trained by the finest qualified professionals
● 100% practical training
● Flexible timings
● Cost-Efficient
● Real-Time Projects
● Resume Writing Preparation
● Mock Tests & interviews
● Access to KVCH’s Learning Management System Platform
● Access to 1000+ Online Video Tutorials
● Weekend and Weekdays batches
● Affordable Fees
● Complete course support
● Free Demo Class
● Guidance till you reach your goal.

**Upgrade Your Self with KVCH’s Big Data Hadoop Training Course!
**
Extensively narrating the IT world presently gets upgraded with ever-renewing technologies every minute. If one lacks much familiarity in coding and doesn’t have an adequate hands-on scripting understanding but still wishes to make an impression in the technical business that too in the IT sector, Big Data Hadoop Online Training is perhaps the niche one requires to begin at. Taking up professional Big Data Training is thus the best option to get to the depth of this language. If one doesn’t have much acquaintance in coding and doesn’t have a good hands-on scripting experience but still wants to make a mark in the technical career that too in the IT sector, Hadoop Corporate Training is probably the place one needs to start at. Adopting skilled Big Data Hadoop Online Training is therefore the promising possibility to get to the center of this language.

#best big data hadoop training in noida #big data analytics training in noida #learn big data hadoop #big data hadoop training course #big data hadoop training and certification #big data hadoop course

Hadoop vs Spark | Hadoop MapReduce vs Spark

In this video on Hadoop vs Spark you will understand about the top Big Data solutions used in the IT industry, and which one should you use for better performance. So in this Hadoop MapReduce vs Spark comparison some important parameters have been taken into consideration to tell you the difference between Hadoop and Spark also which one is preferred over the other in certain aspects in detail.

Why Hadoop is important

Big data hadoop is one of the best technological advances that is finding increased applications for big data and in a lot of industry domains. Data is being generated hugely in each and every industry domain and to process and distribute effectively hadoop is being deployed everywhere and in every industry.

#Hadoop vs Spark #Apache Spark vs Hadoop #Spark vs Hadoop #Difference Between Spark and Hadoop #Intellipaat

Top 12 Real Time Big Data Hadoop Applications

In this article, you will study various applications of hadoop. The article enlists real-time use cases of Apache Hadoop. Hadoop technology is used by many companies belonging to different domains. The article covers some of the top applications of Apache Hadoop.

#Hadoop Tutorials #applications of hadoop #Hadoop applications #hadoop use cases