Data elevator: Low-contention data movement in hierarchical storage system

B Dong, S Byna, K Wu, H Johansen… - 2016 IEEE 23rd …, 2016 - ieeexplore.ieee.org
Hierarchical storage subsystems that include multiple layers of burst buffers (BB) and disk-
based parallel file systems (PFS), are becoming an essential part of HPC systems to …

UniviStor: Integrated hierarchical and distributed storage for HPC

T Wang, S Byna, B Dong, H Tang - 2018 IEEE International …, 2018 - ieeexplore.ieee.org
High performance computing (HPC) architectures have been adding new layers of storage,
such as burst buffers, to tolerate latency between memory and disk-based file systems …

Metakv: A key-value store for metadata management of distributed burst buffers

T Wang, A Moody, Y Zhu, K Mohror… - 2017 IEEE …, 2017 - ieeexplore.ieee.org
Distributed burst buffers are a promising storage architecture for handling I/O workloads for
exascale computing. Their aggregate storage bandwidth grows linearly with system node …

On the role of burst buffers in leadership-class storage systems

N Liu, J Cope, P Carns, C Carothers… - 2012 IEEE 28th …, 2012 - ieeexplore.ieee.org
The largest-scale high-performance (HPC) systems are stretching parallel file systems to
their limits in terms of aggregate bandwidth and numbers of clients. To further sustain the …

Accelerating I/O performance of big data analytics on HPC clusters through RDMA-based key-value store

NS Islam, D Shankar, X Lu… - 2015 44th …, 2015 - ieeexplore.ieee.org
Hadoop Distributed File System (HDFS) is the underlying storage engine of many Big Data
processing frameworks such as Hadoop MapReduce, HBase, Hive, and Spark. Even though …

Hermes: a heterogeneous-aware multi-tiered distributed I/O buffering system

A Kougkas, H Devarajan, XH Sun - Proceedings of the 27th International …, 2018 - dl.acm.org
Modern High-Performance Computing (HPC) systems are adding extra layers to the memory
and storage hierarchy named deep memory and storage hierarchy (DMSH), to increase I/O …

Boldio: A hybrid and resilient burst-buffer over lustre for accelerating big data i/o

D Shankar, X Lu, DK Panda - … Conference on Big Data (Big Data …, 2016 - ieeexplore.ieee.org
The limitation of local storage space in the HPC environments has placed an unprecedented
demand on the performance of the underlying shared parallel file systems. This has …

Burstmem: A high-performance burst buffer system for scientific applications

T Wang, S Oral, Y Wang, B Settlemyer… - … Conference on Big …, 2014 - ieeexplore.ieee.org
The growth of computing power on large-scale systems requires commensurate high-
bandwidth I/O systems. Many parallel file systems are designed to provide fast sustainable …

Trio: Burst buffer based i/o orchestration

T Wang, S Oral, M Pritchard, B Wang… - 2015 IEEE International …, 2015 - ieeexplore.ieee.org
The growing computing power on leadership HPC systems is often accompanied by ever-
escalating failure rates. Checkpointing is a common defensive mechanism used by scientific …

On efficient hierarchical storage for big data processing

KR Krish, B Wadhwa, MS Iqbal… - 2016 16th IEEE/ACM …, 2016 - ieeexplore.ieee.org
A promising trend in storage management for big data frameworks, such as Hadoop and
Spark, is the emergence of heterogeneous and hybrid storage systems that employ different …