[HTML][HTML] Fault tolerance in big data storage and processing systems: A review on challenges and solutions

M Saadoon, SHA Hamid, H Sofian… - Ain Shams Engineering …, 2022 - Elsevier
Big data systems are sufficiently stable to store and process a massive volume of rapidly
changing data. However, big data systems are composed of large-scale hardware resources …

An improved federated learning approach enhanced internet of health things framework for private decentralized distributed data

C Huang, G Xu, S Chen, W Zhou, EYK Ng… - Information …, 2022 - Elsevier
With the privacy protection increasingly being concerned, Data centralization often heavily
causes a big risk of privacy protection, gradually, there is a prevailing trend to enhance the …

Meteorological data layout and task scheduling in a multi-cloud environment

Y Hao, J Cao, Q Wang, T Ma, Q Wang… - Engineering Applications of …, 2023 - Elsevier
The meteorological cloud mainly provides computing ability and meteorological datasets for
meteorological model tasks. If the location of the required dataset and the execution location …

TPBF: Two-Phase Bloom-Filter-Based End-to-End Data Integrity Verification Framework for Object-Based Big Data Transfer Systems

P Kasu, P Hamandawana, TS Chung - Mathematics, 2022 - mdpi.com
Computational science simulations produce huge volumes of data for scientific research
organizations. Often, this data is shared by data centers distributed geographically for …

CRBF: Cross-Referencing Bloom-Filter-Based Data Integrity Verification Framework for Object-Based Big Data Transfer Systems

P Kasu, P Hamandawana, TS Chung - Applied Sciences, 2023 - mdpi.com
Various components are involved in the end-to-end path of data transfer. Protecting data
integrity from failures in these intermediate components is a key feature of big data transfer …

A survey on logging in distributed system

S Silalahi, RM Ijtihadie, T Ahmad… - 2022 1st International …, 2022 - ieeexplore.ieee.org
Systems' performance evaluation and improvement are endless as long as a system runs.
This requires several records of data containing the chronological order of executed …

DLFT: Data and layout aware fault tolerance framework for big data transfer systems

P Kasu, P Hamandawana, TS Chung - IEEE Access, 2021 - ieeexplore.ieee.org
Various scientific research organizations generate several petabytes of data per year
through computational science simulations. These data are often shared by geographically …

Adaptive Buffer Capture and Storage for High-Speed Cameras

Z Hong, S Sun, X Tong, R Zhou, H Pan, Y Zhang… - IEEE …, 2022 - ieeexplore.ieee.org
The output speed of a high-resolution camera with a fast frame rate is high, reaching 800
MB/s or even more. Consequently, the abundant data recorded can easily cause data …

[PDF][PDF] Data Layout and Scheduling Tasks in a Meteorological Cloud Environment.

K Wang, Y Hao, J Cao - Intelligent Automation & Soft Computing, 2023 - cdn.techscience.cn
Meteorological model tasks require considerable meteorological basis data to support their
execution. However, if the task and the meteorological datasets are located on different …

[PDF][PDF] Innovation of Information Management System in the Context of Big Data

T Mao - 2024 - webofproceedings.org
In this article, the innovation direction of Information Management System (IMS) is
comprehensively discussed by combining in-depth theoretical analysis and case study. In …