A solution to image processing with parallel MPI I/O and distributed NVRAM cache

A Malinowski, P Czarnul - Scalable Computing: Practice and Experience, 2018 - scpe.org
Scalable Computing: Practice and Experience, 2018scpe.org
The paper presents a new approach to parallel image processing using byte addressable,
non-volatile memory (NVRAM). We show that our custom built MPI I/O implementation of
selected functions that use a distributed cache that incorporates NVRAMs located in cluster
nodes can be used for efficient processing of large images. We demonstrate performance
benefits of such a solution compared to a traditional implementation without NVRAM for
various sizes of buffers used to read image parts, process and write back to storage. We also …
Abstract
The paper presents a new approach to parallel image processing using byte addressable, non-volatile memory (NVRAM). We show that our custom built MPI I/O implementation of selected functions that use a distributed cache that incorporates NVRAMs located in cluster nodes can be used for efficient processing of large images. We demonstrate performance benefits of such a solution compared to a traditional implementation without NVRAM for various sizes of buffers used to read image parts, process and write back to storage. We also show that our implementation benefits from overlapping reading subsequent images while processing already loaded ones. We present results obtained in a cluster environment for three parallel implementation of blur, multipass blur and Sobel filters, for various NVRAM parameters such as latencies and bandwidth values.
scpe.org
以上显示的是最相近的搜索结果。 查看全部搜索结果