Activated Data Management: Data Fabric and Data Mesh, Key differences, How they Help and Proven benefits from their coexistence.

Aggregated view of Data Fabric and Data Mesh from various sources online


Problems your organization is facing right now.

  1. Siloed data. The bulk of raw data that is only accessible by a line of business but isolated from the rest of that organization, has resulted in a severe lack of transparency, efficiency, and trust within that organization. It makings the job of C-level executes very hard to consolidate all data of the business to create a 360-degree view.
  2. The complexity of data integration prevents organizations from maximizing the value of and fully leveraging their data. Traditional data integration is no longer sufficient to meet business requirements such as universal transformations, real-time connectivity, etc. Integrating, processing, and transforming organizational data with data from multiple sources is a challenge for many organizations.
  3. Data identification authentication. Since data is spread across various systems or stored in a monolithic data lake with a team maintaining it, having no knowledge of its relevance, has caused data authenticity issues. It has also created data knowledge ambiguity. For example, the analysis staff has multiple, self-contained systems that use different names for IDs. This is causing persistent friction in your organization, constant cross-checking and filtering are required, every time you need data for specific needs for example customer revenue reports, etc.
  4. Surrogate Data. The accuracy of the statistics in a report depends primarily on the data selected and its quality. When the selected data are not found across these self-contained systems, there is a tendency to substitute surrogate data. This is what affects the report’s accuracy.
  5. Multilevel Approvals. In an organization with hierarchal and traditional philosophy multi-level approval just to get data has a direct impact on time to market for business.
  6. Combining data from multiple lines of business to create a 360-degree view. Data spread across multiple silos or stored in a central data lake using various technologies for integration is challenging. Not only integration but data integrity is also questioned because data is usually maintained by teams who don’t understand the relevance of the data for the specific line of business.
  7. Offline data. The proliferation of data with various data sources and in fact in bigger organizations data is even stored in EUCs due to which they have always required specialized analysts to spend an inordinate amount of time in cleansing, organizing, and aggregating data in a manual manner.
  8. Data Find-ability / Discovery. Struggle with a breakdown in communication between data experts, business leaders, and their teams who rely on data analyses to do their jobs. There is no ability to discover as well as analyze patterns and trends within data sets to enable businesses to provide themselves with a competitive edge.

Let’s understand what data fabric and data mesh approaches suggest.

What is a data fabric?

What is a data mesh?

Key Differences between Data Fabric and Data Mesh

  • Data fabric is essentially the opposite of data mesh, where the developers will be writing code for the APIs to the interface of the application. Unlike the data mesh, data fabric is a no-code or low-code method, where the API integration is executed in the fabric without leveraging it directly.
  • Data fabric is more technology-centric while data mesh is more dependent on organizational change.
  • Data fabric products are mainly developed on production usage patterns, whereas data mesh products are designed by business domains.
  • The Discovery of metadata is continuous, and the analysis is an ongoing process in the case of Data Fabric, while in the case of data mesh the metadata operates in a localized business domain and is static in nature.
  • From a deployment standpoint, data fabric harnesses the current infrastructure facility available, whereas data mesh extrapolates the current infrastructure with new deployments in business domains.
  • Data mesh advocates product thinking for data as a core design principle. As a result, data is maintained and provisioned like any other product in the organization with a data mesh. Where data fabric leverages automation in discovering, connecting, recognizing, suggesting, and delivering data assets to data consumers based on a rich enterprise metadata foundation (e.g., a knowledge graph), data mesh relies on data product/domain owners to drive the requirements upfront for data products.
  • Data mesh is more about people and process than architecture, while a data fabric is an architectural approach that tackles the complexity of data and metadata in a smart way that works well together.

Benefits from the coexistence of concepts from data mesh and data fabric to organization

  • Provides data owners data products creation capabilities like cataloging data assets, transforming assets into products, and following federated governance policies.
  • Enable data owners and data consumers to use the data products in various ways such as publishing data products to the catalog, searching and finding data products, and querying or visualizing data products leveraging data virtualization or using APIs.
  • Use insights from data fabric metadata to automate tasks by learning from patterns as part of the data product creation process or as part of the process of monitoring data products.
  • When it comes to data management, a data fabric provides the capabilities needed to implement and take full advantage of a data mesh by automating many of the tasks required to create data products and manage the lifecycle of data products.
  • A data fabric gives you the flexibility to start with a use case allowing you to get quick-time-to-value regardless of where your data is.
  • By using the flexibility of a data fabric foundation, you can implement a data mesh, continuing to take advantage of a use case-centric data architecture regardless if your data resides on-premises or in the cloud.
  • Experts from both worlds agree to have a self-serve data platform.
  • Both data fabric and mesh enable people to use and reuse data by making the most valuable assets the most visible for wider use.
  • Both promote the use of Metadata. In data mesh, we have a domain-driven design, and in data fabric, we have activated metadata.

Subscribe to my newsletter and get a mindmap of each post



Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store

Software engineer, Big data application architect and programming language enthusiast. A guy who like technical discussions . Author on