Introduction:

In this article I will discuss how to monitor and debug a PolyBase Load in Azure Synapse Analytics using system views and custom views (user created) and some best practices I followed for PolyBase load using T-SQL (CTAS/INSERT) and ADF.

Problem Statement:

I am working on Azure Synapse Analytics for quite some time now and during my journey, I faced many challenges especially regarding query monitoring and debugging. I am sharing my experiences on how we can monitor a load in Azure Synapse Analytics .

Architecture Diagram:

Before discussing the monitoring and debugging options, let’s discuss about the architecture first.and distribution strategies.

#azure-data-factory #polybase #etl #azure #azure-synapse-analytics