How to visualize your nested IoT data in 3d using Spark and Power BI

How to visualize your nested IoT data in 3d using Spark and Power BI

In this post, we will learn: how to transform nested IoT data in a scalable way how to create custom python visualizations in Power BI how data can be consumed and visualized by non-technical end-users through a web browser

A. Introduction

Every now and then, you run into new unique problems to solve. This time it was a client getting nested IoT data. Storing and visualizing IoT data is usually a standard task, but getting nested IoT data as a “matrix” per message with corresponding vectors is not as straightforward as usual.

In this post, we will learn:

  • how to transform nested IoT data in a scalable way
  • how to create custom python visualizations in Power BI
  • how data can be consumed and visualized by non-technical end-users through a web browser

We will use Spark, Python, and Power BI to solve our problem in some simple steps.

B. Data Structure

First, let’s take a look at what the data looks like when it comes from the IoT devices:

In the picture above we can see a subset of the IoT data that we will focus on to solve the specific problem with a “matrix” type of data per message/row. The IoT data contains many other columns of standard types, but we will only look at how to handle the complex types in this post.

Each position and value in the “matrix” are connected to a specific x_value and y_value. See the picture below.

matplotlib spark python power-bi

What is Geek Coin

What is GeekCash, Geek Token

Best Visual Studio Code Themes of 2021

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Microsoft Power BI Consulting | Power BI Solutions in India

Perform Data Analysis & Report Creation with our Microsoft Power BI Consulting Services. Our Power BI consultants help in BI solutions and execute business requirements gathering, architecture design, implementation, user training, cloud management, report enhancements projects, etc

Hire Power BI Developer | Microsoft Power BI consultants in India

Hire our expert Power BI consultants to make the most out of your business data. Our power bi developers have deep knowledge in Power BI data modeling, structuring, and analysis. 16+ Yrs exp | 2500+ Clients| 450+ Team

power bi course | power bi training | OnlineITGuru

Our Power BI Training will provide you to learn the Power BI tools and making reports easily with realty. Our Power BI Course also includes live sessions, live Pro

Power BI In Brief – 2020

Every month, we bring you news, tips, and expert opinions on Power BI? Do you want to tap into the power of Power BI? Ask the Power BI experts at ArcherPoint. ![This is image...

Comparing Power BI with other tools

Our Power BI Training will provide you to learn the Power BI tools and making reports easily with realty. Our Power BI Course also includes live sessions, live Pro