Z Wu, J Sun, Y Zhang, Z Wei… - Proceedings of the …, 2021 - ieeexplore.ieee.org
This article gives a survey of state-of-the-art methods for processing remotely sensed big data and thoroughly investigates existing parallel implementations on diverse popular high …
We have developed Ceph, a distributed file system that provides excellent performance, reliability, and scalability. Ceph maximizes the separation between data and metadata …
R Thakur, W Gropp, E Lusk - Proceedings. Frontiers' 99 …, 1999 - ieeexplore.ieee.org
The I/O access patterns of parallel programs often consist of accesses to a large number of small, noncontiguous pieces of data. If an application's I/O needs are met by making many …
Computational science applications are driving a demand for increasingly powerful storage systems. While many techniques are available for capturing the I/O behavior of individual …
R Thakur, W Gropp, E Lusk - Proceedings of the sixth workshop on I/O in …, 1999 - dl.acm.org
We discuss the issues involved in implementing MPI-IO portably on multiple machines and file systems and also achieving high performance. One way to implement MPI-IO portably is …
Developing and tuning computational science applications to run on extreme scale systems are increasingly complicated processes. Challenges such as managing memory access and …
We examine the I/O behavior of thousands of supercomputing applications" in the wild," by analyzing the Darshan logs of over a million jobs representing a combined total of six years …
Deduplication is a storage saving technique that is highly successful in enterprise backup environments. On a file system, a single data block might be stored multiple times across …