[PDF][PDF] A Multi-objective Optimization Service for Enhancing Performance and Cost Efficiency in Earth Observation Data Processing Workflows.

A Lalayan, H Astsatryan, G Giuliani - Baltic Journal of Modern …, 2023 - researchgate.net
Baltic Journal of Modern Computing, 2023researchgate.net
Earth observation technology has become increasingly crucial for monitoring various
aspects of our planet through systematic data collection. However, processing the large
volume of satellite data generated can be challenging, requiring high-performance
computing solutions. The Dask framework has gained popularity for its flexibility and
efficiency in processing large amounts of data in a distributed manner. Nevertheless,
determining the optimal Dask cluster configuration remains challenging, as it requires …
Abstract
Earth observation technology has become increasingly crucial for monitoring various aspects of our planet through systematic data collection. However, processing the large volume of satellite data generated can be challenging, requiring high-performance computing solutions. The Dask framework has gained popularity for its flexibility and efficiency in processing large amounts of data in a distributed manner. Nevertheless, determining the optimal Dask cluster configuration remains challenging, as it requires balancing performance and cost objectives. A novel multi-objective optimization service is proposed to address this challenge that enhances the performance and cost efficiency of earth observation data processing workflows. Our approach is to generate a set of Pareto-optimal solutions, allowing users to make informed decisions regarding the optimal trade-offs between performance and cost. The effectiveness is demonstrated using real-world earth observation datasets and outperforms existing performance and cost-efficiency solutions.
researchgate.net
以上显示的是最相近的搜索结果。 查看全部搜索结果