Survey on prediction models of applications for resources provisioning in cloud

M Amiri, L Mohammad-Khanli - Journal of Network and Computer …, 2017 - Elsevier
According to the dynamic nature of cloud and the rapid growth of the resources demand in it,
the resource provisioning is one of the challenging problems in the cloud environment. The …

On the use of machine learning to predict the time and resources consumed by applications

A Matsunaga, JAB Fortes - 2010 10th IEEE/ACM International …, 2010 - ieeexplore.ieee.org
Most data centers, clouds and grids consist of multiple generations of computing systems,
each with different performance profiles, posing a challenge to job schedulers in achieving …

Improving backfilling by using machine learning to predict running times

E Gaussier, D Glesser, V Reis, D Trystram - Proceedings of the …, 2015 - dl.acm.org
The job management system is the HPC middleware responsible for distributing computing
power to applications. While such systems generate an ever increasing amount of data, they …

Cost effective, reliable and secure workflow deployment over federated clouds

Z Wen, J Cała, P Watson… - IEEE Transactions on …, 2016 - ieeexplore.ieee.org
The significant growth in cloud computing has led to increasing number of cloud providers,
each offering their service under different conditions-one might be more secure whilst …

A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds

Z Cai, X Li, R Ruiz, Q Li - Future Generation Computer Systems, 2017 - Elsevier
Abstract Bag-of-Tasks (BoT) workflows are widespread in many big data analysis fields.
However, there are very few cloud resource provisioning and scheduling algorithms tailored …

Prediction of job characteristics for intelligent resource allocation in HPC systems: a survey and future directions

Z Hou, H Shen, X Zhou, J Gu, Y Wang… - Frontiers of Computer …, 2022 - Springer
Nowadays, high-performance computing (HPC) clusters are increasingly popular. Large
volumes of job logs recording many years of operation traces have been accumulated. In the …

Online task resource consumption prediction for scientific workflows

RF Da Silva, G Juve, M Rynge, E Deelman… - Parallel Processing …, 2015 - World Scientific
Estimates of task runtime, disk space usage, and memory consumption, are commonly used
by scheduling and resource provisioning algorithms to support efficient and reliable …

Obtaining dynamic scheduling policies with simulation and machine learning

D Carastan-Santos, RY De Camargo - Proceedings of the International …, 2017 - dl.acm.org
Dynamic scheduling of tasks in large-scale HPC platforms is normally accomplished using
ad-hoc heuristics, based on task characteristics, combined with some backfilling strategy …

Dynamic and fault-tolerant clustering for scientific workflows

W Chen, RF da Silva, E Deelman… - IEEE Transactions on …, 2015 - ieeexplore.ieee.org
Task clustering has proven to be an effective method to reduce execution overhead and to
improve the computational granularity of scientific workflow tasks executing on distributed …

Elasticsim: A toolkit for simulating workflows with cloud resource runtime auto-scaling and stochastic task execution times

Z Cai, Q Li, X Li - Journal of Grid Computing, 2017 - Springer
Resource provisioning and scheduling are crucial for cloud workflow applications.
Simulation is one of the most promising evaluation methods for different resource …