Data Mesh Principles and Logical Architecture Defined

Data Mesh Principles and Logical Architecture Defined

Data Mesh Principles and Logical Architecture Defined. Data mesh addresses these dimensions, founded in four principles: domain-oriented decentralized data ownership and architecture. The concept of a data mesh provides new ways to address common problems around managing data at scale.

The concept of a data mesh provides new ways to address common problems around managing data at scale.  Zhamak Dehghani has  provided additional clarity around the four principles of a data mesh, with a corresponding logical architecture and organizational structure. Her article is intended as a follow up to previous  articles,  presentations, and  podcasts that introduced people to data mesh and domain-oriented data.

Dehghani emphasizes the "great divide" between operational data and analytical data. Traditionally, a data pipeline of ETL jobs (extract, transform, and load) spans this divide between transactional data used for running the business, and data lakes and data warehouses used to provide insights about the business. Data mesh acknowledges the need for these two distinct viewpoints and use cases, but instead of organizing teams and architectures along technology boundaries, data mesh unites them by focusing on domains. 

By following this topology, analytical data is able to scale in the way microservices and self-contained databases have allowed transactional data to scale. To achieve the promise of scale, along with quality and integrity, Dehghani lays out four principles of a data mesh:

   1. Domain-oriented decentralized data ownership and architecture

   2. Data as a product

   3. Self-serve data infrastructure as a platform

   4. Federated computational governance

data pipelines microservices data mesh ai

Bootstrap 5 Complete Course with Examples

Bootstrap 5 Tutorial - Bootstrap 5 Crash Course for Beginners

Nest.JS Tutorial for Beginners

Hello Vue 3: A First Look at Vue 3 and the Composition API

Building a simple Applications with Vue 3

Deno Crash Course: Explore Deno and Create a full REST API with Deno

How to Build a Real-time Chat App with Deno and WebSockets

Convert HTML to Markdown Online

HTML entity encoder decoder Online

Data Mesh concept - buzzzzz or not?

What is the recently popular data mesh concept and its benefits? With the growing number of data sources and need for agility, a decentralized data architecture concept- Data Mesh can be explored to enforce data quality and governance adherence

What is a Data Mesh — and How Not to Mesh it Up

A beginner’s guide to implementing the latest industry trend: a data mesh. Ask anyone in the data industry what’s hot these days and chances are “data mesh” will rise to the top of the list.

Applications Of Data Science On 3D Imagery Data

The agenda of the talk included an introduction to 3D data, its applications and case studies, 3D data alignment and more.

Data Pipelines With Apache Airflow

A Data Pipeline describes and encode a series of sequential data processing steps. Depending on the data requirements for each step, some steps may occur in parallel.

How to Prevent Broken Data Pipelines with Data Observability

How to Prevent Broken Data Pipelines with Data Observability. And other important questions for data teams.. And other important questions for data teams.