TLDR

• About SQL On-Demand
• Creating the Data Source
• Gaining Access to the Azure Storage
• Querying Files in Azure Storage through Azure Synapse Workspace
• YouTube Video for Visual Description of Steps Below

About SQL On-Demand

In my last post, I mentioned the Top 10 Features in Azure Synapse Analytics. Synapse SQL Database has 2 options: SQL Pool & SQL On-Demand. In this post, I am going to dive in deeper in to the 2nd Option; SQL On-Demand. SQL On-Demand is an interesting feature that will make Query your Data a lot more easier.

So What is SQL On-Demand? According to the Microsoft Docs. It is a

Synapse SQL on-demand (preview) is a serverless query service that enables you to run SQL queries on files placed in Azure Storage.

So what type of files will you find in your storage? These are files like CSV, **Parquet **Files, and JSON. This is quite interesting because typically you’ll have to import these file into your Database, not to mention the making sure the data format is compatible with the target database environment.

How can you Query Files without pulling them in?

This is done by creating an External Data Source. Data Source includes:

• Master Key
• Database Scoped Credential

#azure #azure-sql-database #big-data #sql #azure-synapse-analytics