In this video we will walk through exploratory data analysis using Apache Spark, Databricks and Python. We will see various plots for uni-variate and multi-variate analysis and also understand which plots can help in what scenario. We will explore charts and plots like

  • Bar chart
  • Box Plot
  • Scatter Plot
  • Q-Q Plot
  • Plotting in maps
  • Pivot Table
  • Histograms

Finally we will discuss on how to convert spark dataframe to pandas and challenges of it also use seaborn and matplot to plot simple graph

#python #datascience

Exploratory Data Analysis (EDA) using Apache Spark and Python
1 Likes42.60 GEEK