9. Mesh computing
The evolution of data architecture has so far been a story of increased centralisation. However, faced with a growing volume of different data sources, users and tools, the limits to data centralisation are increasingly obvious.
In most organisations, data is managed by a central team generally resulting in less ownership, less in-depth strategic understanding and poorer data quality. Faced with ever-increasing demand, a central team can also often become a bottleneck.
‘Data mesh’ offers a fresh, decentralised solution to data challenges, focusing on decentralising and democratising data. In a nutshell, putting data ownership back into the hands of the people closest to it: your individual business functions.
A single data catalogue is essential so overall governance would be handled centrally. Similarly, all data users will need to adhere to the same - centrally set - protocols and quality standards. However, your various functions would be responsible for their own data pipelines. For example, some teams who focus purely on operational processes can continue to rely on the central hub. Others, such marketing teams, may work best using their own solutions.