Tuning parameters of Apache Spark with Gauss–Pareto-based multi-objective optimization

MM Öztürk - Knowledge and Information Systems, 2024 - Springer
When there is a need to make an ultimate decision about the unique features of big data
platforms, one should note that they have configurable parameters. Apache Spark is an …

Tuning configuration of apache spark on public clouds by combining multi-objective optimization and performance prediction model

G Cheng, S Ying, B Wang - Journal of Systems and Software, 2021 - Elsevier
Choosing the right configuration for Spark deployed in the public cloud to ensure the
efficient running of periodic jobs is hard, because there can be a huge configuration space …

Multi-objective big data optimization with jmetal and spark

C Barba-Gonzaléz, J García-Nieto, AJ Nebro… - … Conference, EMO 2017 …, 2017 - Springer
Abstract Big Data Optimization is the term used to refer to optimization problems which have
to manage very large amounts of data. In this paper, we focus on the parallelization of …

Parameter tuning of big data platforms for performance optimization

T Pattanshetti, V Attar - Journal of Information and Optimization …, 2020 - Taylor & Francis
The data processing platforms make use of distributed systems to process and store the big
data efficiently. These big data platforms have more than hundreds of configurable …

jMetalSP: a framework for dynamic multi-objective big data optimization

C Barba-González, J García-Nieto, AJ Nebro… - Applied Soft …, 2018 - Elsevier
Multi-objective metaheuristics have become popular techniques for dealing with complex
optimization problems composed of a number of conflicting functions. Nowadays, we are in …

Elite learning Harris hawks optimizer for multi-objective task scheduling in cloud computing

DA Amer, G Attiya, I Zeidan, AA Nasr - The Journal of Supercomputing, 2022 - Springer
The widespread usage of cloud computing in different fields causes many challenges as
resource scheduling, load balancing, power consumption, and security. To achieve a high …

A hierarchical multi-objective task scheduling approach for fast big data processing

Z Jalalian, M Sharifi - The Journal of Supercomputing, 2022 - Springer
Due to the rapid growth of production and dissemination of big data from various sources,
the speed of data processing must inevitably increase. In distributed big data processing …

A hybrid multi-objective whale optimization algorithm for analyzing microarray data based on Apache Spark

AM AbdelAziz, T Soliman, KKA Ghany… - PeerJ Computer …, 2021 - peerj.com
A microarray is a revolutionary tool that generates vast volumes of data that describe the
expression profiles of genes under investigation that can be qualified as Big Data. Hadoop …

HWOA: An intelligent hybrid whale optimization algorithm for multi-objective task selection strategy in edge cloud computing system

Y Kang, X Yang, B Pu, X Wang, H Wang, Y Xu, P Wang - World Wide Web, 2022 - Springer
Edge computing is a popular computing modality that works by placing computing resources
as close as possible to the sensor data to relieve the burden of network bandwidth and data …

A hybrid multi‐objective firefly and simulated annealing based algorithm for big data classification

SG Devi, M Sabrigiriraj - Concurrency and Computation …, 2019 - Wiley Online Library
Efficient management of big data becomes challenging in recent decades. Online Feature
Selection (OFS) is one type of online learning in contrast to batch learning, allowing a …