Data Lakes are becoming more usual every day and the need for tools to query them also increases. While writing about querying a data lake using **Synapse**, I stumbled upon a **Power BI** feature I didn’t know was there. When reading from a...
Data Lakes are becoming more usual every day and the need for tools to query them also increases.
While writing about querying a data lake using Synapse, I stumbled upon a Power BI feature I didn’t know was there.
When reading from a data lake, each folder is like a table. We store in the folder many files with the same structure, each file containing a piece of the data.
Data Lake tools are prepared to deal with the data on this way and read the files transparently for the user, but Power BI required us to read one specific file, not the folder. That’s until last November. If we google (verb: To google) about Power BI and Parquet files we can find many work arounds to read Parquet files in Power BI, but no mention to the new Parquet connector released on last November (https://powerbi.microsoft.com/en-us/blog/whats-new-in-power-query-dataflows-november-2020/), so I had to write about it.
The feature I’m illustrating on this article is in fact a combination of two features:
In order to illustrate how it works, I provided some files to be used in an Azure Storage. You can download the files here. You will also need to provision a new storage account and it will need to be an Azure Data Lake Storage Gen 2.
On the examples, I will use the address https://lakedemo.dfs.core.windows.net/opendatalake/trips for the storage, but you need to replace it with the DFS endpoint of your own storage.
Let’s make a step-by step:
There are 3 storage options:
It’s important to choose the correct option according your storage type, this affects the performance.
Perform Data Analysis & Report Creation with our Microsoft Power BI Consulting Services. Our Power BI consultants help in BI solutions and execute business requirements gathering, architecture design, implementation, user training, cloud management, report enhancements projects, etc
Hire our expert Power BI consultants to make the most out of your business data. Our power bi developers have deep knowledge in Power BI data modeling, structuring, and analysis. 16+ Yrs exp | 2500+ Clients| 450+ Team
In this post, we'll learn Getting Started With Data Lakes.<br><br> This Refcard dives into how a data lake helps tackle these challenges at both ends — from its enhanced architecture that's designed for efficient data ingestion, storage, and management to its advanced analytics functionality and performance flexibility. You'll also explore key benefits and common use cases.
Our Power BI Training will provide you to learn the Power BI tools and making reports easily with realty. Our Power BI Course also includes live sessions, live Pro
JIRA Software provides bug tracking, issue tracking, and project management capabilities for teams and organizations. The JIRA content pack for Power BI helps you quickly import JIRA data so you can get an instant dashboard to analyze workloads...