Delight is a free, open-source, cross-platform, monitoring dashboard for Apache Spark.

Delight is a free, hosted, cross-platform monitoring dashboard for Apache Spark. It’s a great complement to the Spark UI that can help you understand and improve the performance of your Spark applications.

Delight gives you access to:

• Spark-centric CPU and memory metrics graphs that we hope will delight you.
• The Spark UI, so you don’t need to run the Spark History Server yourself.

What we’ll cover in this article:

1. The motivation and timeline of the project
2. Its high-level architecture
3. A tour of the main screens and how they can concretely help you in your day-to-day work

#big data #data science #monitoring #apache spark #presentation #open-source #data engineering #spark ui