In this video, you learn how to use Spark Structured Query Language (SQL) window functions.  Spark SQL is the most performant way to do data engineering on Databricks and window functions expand SQL functionality to include things like cumulative totals, ranking values, and including aggregations alongside detail rows.  They can save you a lot of work. I'll explain the concepts and demonstrate them with code in a Databricks notebook.

#apache-spark #bigdata