Exploiting multi‐cores for efficient interchange of large messages in distributed systems

D Zhao, K Qiao, Z Zhou, T Li, X Zhou… - Concurrency and …, 2016 - Wiley Online Library
Conventional data serialization tools assume that objects to be coded are usually small in
size so a single CPU core can encode it in a timely manner. In the era of Big Data, however …

HPS: A C++ 11 High Performance Serialization Library

J Li - arXiv preprint arXiv:1811.04556, 2018 - arxiv.org
Data serialization is a common and crucial component in high performance computing. In
this paper, I present a C++ 11 based serialization library for performance critical systems. It …

A specialized architecture for object serialization with applications to big data analytics

J Jang, SJ Jung, S Jeong, J Heo, H Shin… - 2020 ACM/IEEE 47th …, 2020 - ieeexplore.ieee.org
Object serialization and deserialization (S/D) is an essential feature for efficient
communication between distributed computing nodes with potentially non-uniform execution …

[PDF][PDF] Beyond JSON: Evaluating Serialization Formats for Space-Efficient Communication

E Maltsev, O Muliarevych - Advances in Cyber-Physical Systems, 2024 - science.lpnu.ua
Distributed systems rely on efficient inter-service communication, heavily impacted by data
transmission costs. This study investigates alternative serialization formats, like Avro and …

[PDF][PDF] Optimizing binary serialization with an independent data definition format

DC Castillo, J Rosales, GAT Blanco - International Journal of …, 2018 - researchgate.net
The current technologies used for message communication over a network, will begin to be
inefficient as the diversity of the hardware and the need to transfer more information in less …

Breakfast of champions: towards zero-copy serialization with NIC scatter-gather

D Raghavan, P Levis, M Zaharia, I Zhang - Proceedings of the Workshop …, 2021 - dl.acm.org
Microsecond I/O will make data serialization a major bottleneck for datacenter applications.
Serialization is fundamentally about data movement: serialization libraries coalesce and …

dCache–Efficient Message Encoding For Inter-Service Communication in dCache: Evaluation of Existing Serialization Protocols as a Replacement for Java Object …

L Morschel, O Adeyemi, V Garonne… - EPJ Web of …, 2020 - epj-conferences.org
As a well established, large-scale distributed storage system, dCache is used to manage
and serve huge amounts of data collected by high energy physics, astrophysics and photon …

[PDF][PDF] Efficient Message Serialization for Inter-Service Communication in dCache

L Morschel, D Säring, T Mkrtchyan - 2019 - bib-pubdb1.desy.de
As a well established, large-scale distributed storage system, dCache is used to manage
and serve huge amounts of data collected by high energy physics, astrophysics and photon …

Benchmarking Performance of Data Serialization and RPC Frameworks in Microservices Architecture: gRPC vs. Apache Thrift vs. Apache Avro

T Nguyen - 2016 - aaltodoc.aalto.fi
Microservices Architecture is becoming an prominent standard when it comes to designing
high-level architecture of complex applications. Each microservice addresses one small part …

An analysis of python serialization towards distributed systems

E Tangmunchittham… - 2022 19th International …, 2022 - ieeexplore.ieee.org
We explored the current state of Python serialization in the context of distributed computing.
The challenging points addressed are: object-type support, speed and size, version …