Scaling embedded in-situ indexing with deltaFS

Q Zheng, CD Cranor, D Guo, GR Ganger… - … Conference for High …, 2018 - ieeexplore.ieee.org
Analysis of large-scale simulation output is a core element of scientific inquiry, but analysis
queries may experience significant I/O overhead when the data is not structured for efficient …

Methodology for the rapid development of scalable HPC data services

M Dorier, P Carns, K Harms, R Latham… - 2018 IEEE/ACM 3rd …, 2018 - ieeexplore.ieee.org
Growing evidence in the scientific computing community indicates that parallel file systems
are not sufficient for all HPC storage workloads. This realization has motivated extensive …

Streaming data reorganization at scale with DeltaFS indexed massive directories

Q Zheng, CD Cranor, A Jain, GR Ganger… - ACM Transactions on …, 2020 - dl.acm.org
Complex storage stacks providing data compression, indexing, and analytics help leverage
the massive amounts of data generated today to derive insights. It is challenging to perform …

Data Storage Research Vision 2025: Report on NSF Visioning Workshop held May 30--June 1, 2018

G Amvrosiadis, AR Butt, V Tarasov, E Zadok, M Zhao… - 2018 - dl.acm.org
With the emergence of new computing paradigms (eg, cloud and edge computing, big data,
Internet of Things (IoT), deep learning, etc.) and new storage hardware (eg, non-volatile …

Workload-aware storage policies for cloud object storage

Y Chen, W Tong, D Feng, Z Wang - Journal of Parallel and Distributed …, 2022 - Elsevier
Different applications have different access characteristics and various performance
requirements. Thus, the shared cloud object store entails providing tenant-specific policies …

[PDF][PDF] Data storage research vision 2025 report

G Amvrosiadis, AR Butt, V Tarasov, E Zadok, M Zhao - Technical Report, 2019 - par.nsf.gov
With the emergence of new computing paradigms (eg, cloud and edge computing, big data,
Internet of Things (IoT), deep learning, etc.) and new storage hardware (eg, non-volatile …

Mass: Workload-aware storage policy for openstack swift

Y Chen, W Tong, D Feng, Z Wang - Proceedings of the 49th International …, 2020 - dl.acm.org
A cloud object store entails serving workloads of multi tenants. Different applications have
different access characteristics and various performance requirements. Thus, it is necessary …

The Next Generation of EMPRESS: A Metadata Management System for Accelerated Scientific Discovery at Exascale

MR Lawson - 2018 - digitalcommons.dartmouth.edu
Scientific data sets have grown rapidly in recent years, outpacing the growth in memory and
network bandwidths. This I/O bottleneck has made it increasingly difficult for scientists to …

Compact Filters for Fast Online Data Partitioning

Q Zheng, CD Cranor, A Jain, GR Ganger… - 2019 IEEE …, 2019 - ieeexplore.ieee.org
We are approaching a point in time when it will be infeasible to catalog and query data after
it has been generated. This trend has fueled research on in-situ data processing (ie …

[图书][B] Data storage research vision 2025

G Amvrosiadis, AR Butt, V Tarasov, E Zadok, M Zhao - 2018 - cs.fsu.edu
With the emergence of new computing paradigms (eg, cloud and edge computing, big data,
Internet of Things (IoT), deep learning, etc.) and new storage hardware (eg, non-volatile …