Epoxy: ACID transactions across diverse data stores

P Kraft, Q Li, X Zhou, P Bailis, M Stonebraker… - Proceedings of the …, 2023 - dl.acm.org
Proceedings of the VLDB Endowment, 2023dl.acm.org
Developers are increasingly building applications that incorporate multiple data stores, for
example to manage heterogeneous data. Often, these require transactional safety for
operations across stores, but few systems support such guarantees. To solve this problem,
we introduce Epoxy, a protocol for providing transactions across heterogeneous data stores.
We make two contributions. First, we adapt multi-version concurrency control to a cross-data
store setting, storing versioning information in record metadata and filtering reads with …
Developers are increasingly building applications that incorporate multiple data stores, for example to manage heterogeneous data. Often, these require transactional safety for operations across stores, but few systems support such guarantees. To solve this problem, we introduce Epoxy, a protocol for providing transactions across heterogeneous data stores. We make two contributions. First, we adapt multi-version concurrency control to a cross-data store setting, storing versioning information in record metadata and filtering reads with predicates on metadata so they only see record versions in a global transaction snapshot. Second, we show our design enables an atomic commit protocol that does not require data stores implement the participant protocol of two-phase commit, requiring only durable writes. We implement Epoxy for five data stores: Postgres, Elasticsearch, MongoDB, Google Cloud Storage, and MySQL. We evaluate it by adapting TPC-C and microservice workloads to a multi-data store environment. We find it has comparable performance to the distributed transaction protocol XA on TPC-C while providing stronger guarantees like isolation, and has overhead of <10% compared to a non-transactional baseline on read-mostly microservice workloads and 72% on write-heavy workloads.
ACM Digital Library
以上显示的是最相近的搜索结果。 查看全部搜索结果