Trick or Treat: Centralized Data Lake vs Decentralized Data Mesh - Université de Montpellier Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Trick or Treat: Centralized Data Lake vs Decentralized Data Mesh

Résumé

Over the course of the last few years, the augmentation of processed data and an increase in the need for fast product release cycles led to the emergence of bottlenecks in information and knowledge flows within large organizations. Recent research works attempted to resolve these issues from several perspectives, which span from the data platform architectures to the storage technologies. In this positional paper, we start by comparing the well-established methods of designing analytical data platforms and make a review of existing problems inherent to them, namely centralization of storage and ownership. It continues by analyzing the principles of a data mesh proposal and by providing an examination of unresolved challenges, such as metadata centralization. We further consider the business domain dependencies and platform architecture of our running example. The final section presents our vision for solving the identified metadata management issues in large enterprises via data decentralization and offers potential directions for future work.
Fichier principal
Vignette du fichier
Trick_or_Treat_MEDES_23.pdf (3 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04156120 , version 1 (07-07-2023)

Identifiants

  • HAL Id : hal-04156120 , version 1

Citer

Anton Dolhopolov, Arnaud Castelltort, Anne Laurent. Trick or Treat: Centralized Data Lake vs Decentralized Data Mesh. 2023. ⟨hal-04156120⟩
136 Consultations
143 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More