Just over a month on from the crowds and excitement at Big Data London (BDL).\u00a0 One of the key themes, which even had its own theatre was Data Mesh, and most of the two days were spent debating Data Mesh’s merits. While the first and second Data Mesh principles of \u201cData as a Product\u201d and \u201cDecentralised Data Domains\u201d stole the limelight in London, there was little debate about the fourth, and arguably the most important, principle, that of Federated Data Governance.<\/p>\n
It is arguably the most important and least understood Data Mesh principle.\u00a0 This is odd, given that it will be critical to Data Mesh success in particular, but will fundamentally change how Data Governance is delivered going forward. Why do I believe this to be the case?<\/p>\n
Let\u2019s consider the theory and how data governance is delivered in most organisations through the usual lens of People, Process, and Technology.<\/p>\n
The Theory<\/strong><\/p>\n Data Mesh assumes that the overarching Data Governance policies, procedures, and standards will be agreed upon and written at the Federated level.\u00a0 This is the level above the Data Domains themselves so effectively by a central function or team.\u00a0 These Data Governance artifacts will then be deployed into a Data Mesh solution through largely automated mechanisms to ensure that the data being used by data domain users is accessible, available, complete, accurate, and fit for purpose.<\/p>\n The Reality<\/strong><\/p>\n This sounds great at a conceptual level, but when you sit that alongside what is being done in many organisations to implement Data Governance at the moment, it is a million miles away from how businesses are typically trying to deploy their data governance framework.<\/p>\n If we believe that Data Mesh will become the new data paradigm, then those doing Data Governance will need to change their approach and behaviours not just slightly but materially. Let\u2019s consider this in terms of People, Process and Technology.<\/p>\n People<\/strong><\/p>\n In the event of Data Governance being delivered through more automated mechanisms, it is evident that the skills needed will move into a more technically led space. Currently, many Data Governance practitioners have fallen into the discipline because they are good with numbers, have loads of common sense, and can talk to stakeholders.\u00a0 Successful Data Governance professionals in the future will need not just these skills but equivalent technical skills \u2013 well beyond the doing a bit of SQL that most of us have seen in the past.<\/p>\n We are already starting to see this shift in recruiting Data Governance professionals who need strong technical and non-technical skills.<\/p>\n Process<\/strong><\/p>\n A Data Governance framework is currently designed and deployed through a blend of Website, Intranet, Training & Education type mechanisms.\u00a0 In Data Mesh, policies, standards, and procedures will be far more automated, so the processes underpinning good Data Governance will have to change.\u00a0 In the same way, those doing Data Governance will need to have a good grounding in designing and building these automated processes.<\/p>\n Technology<\/strong><\/p>\n As the Technology underpinning Data Mesh can be expected to use a heavy recycling or realignment of existing technologies \u2013 with the odd addition of faster query engines such as Starburst \u2013 this is likely to have the least impact on current Data Governance best practice.\u00a0 So long as Data Governance practitioners understand the value and implications of their respective Data Governance technical solutions, this area is least likely to evolve.<\/p>\n So is Data Governance at an evolutionary tipping point? We are now starting to see changes in how data governance is delivered to organisations. Adoption of Data Mesh can and will escalate that evolution.\u00a0 It remains to be seen who will be the winners and who will be the losers.<\/p>\n Andrew Sharp is a Senior Data Governance Consultant at The Oakland Group<\/p>\n","protected":false},"excerpt":{"rendered":" Just over a month on from the crowds and excitement at Big Data London (BDL).\u00a0 One of the key themes, which even had its own theatre was Data Mesh, and most of the two days were spent debating Data Mesh’s merits. While the first and second Data Mesh principles of \u201cData as a Product\u201d and…<\/p>\n","protected":false},"author":20,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"content-type":"","footnotes":""},"categories":[403],"tags":[77,356,323,357,358],"class_list":["post-6827","post","type-post","status-publish","format-standard","hentry","category-data-governance","tag-big-data-london","tag-data-domain","tag-data-mesh","tag-data-products","tag-federated-data-governance"],"acf":[],"yoast_head":"\n