In this full course video on Big data, you will learn about Big data, Hadoop, and Spark. First, we will look into a big data tutorial, the challenges in big data, and how Hadoop solves these challenges. You will learn how to install Hadoop, then understand the various components of Hadoop that are HDFS, MapReduce, and YARN. HDFS will teach you how to store big data, and MapReduce will show you how to process this big data. In YARN, you will learn how cluster resource management works. In addition to these components, you will also look into the Hadoop ecosystem, which consists of Hive, Pig, Sqoop, and HBase. You will learn to use these tools both through theory and demos. After this, you will see how Big data is used practically across different sectors. You will also have a quick overview of Apache Spark and its installation on both Windows and Ubuntu. Finally, you will see how to become a big data engineer and also look into the important Hadoop interview questions. Now, let’s get started and learn Big data.
Below topics are explained in this Big Data full course video:1.Evolution of Big Data - 00:58
2.Why Big Data? - 05:38
3.What is Big Data? - 10:18
4.5 V’s of Big Data - 11:48
5.Challenges of Big Data - 24:18
6.Hadoop as a Solution - 27:58
7.Cloudera Hadoop Installation - 30:28
8.Hadoop Ecosystem - 58:39
9.Hadoop Distributed File System - 1:07:00
10.MapReduce Analogy - 1:46:40
11.What is MApReduce? - 1:48:40
12.Parallel Processing-MapReduce - 1:54:20
13.MapReduce Workflow - 1:54:50
14.MapReduce Architecture - 2:01:50
15.Hadoop 1.0(MR 1) - 2:29:50
16.Limitations of Hadoop 1.0(MR 1) - 2:34:30
17.Need for YARN - 2:36:40
18.What is YARN? - 2:39:30
19.YARN Components - 2:41:30
20.YARN Components-Node MAnager -2:49:40
21.What is Sqoop? - 3:35:31
22.Sqoop Features - 3:36:01
23.Sqoop Architecture - 3:37:10
24.What is Apache Spark? - 5:53:02
25.History of Apache Spark - 5:53:32
26.Apache Spark Installation on Windows - 6:30:52
27.Apache Spark Installation on ubuntu - 7:01:42
28.YARN - 8:10:48
#bigdata #hadoop #spark #datascience