Adaptive workflow processing and execution in pegasus

K Lee, NW Paton, R Sakellariou… - Concurrency and …, 2009 - Wiley Online Library
Workflows are widely used in applications that require coordinated use of computational
resources. Workflow definition languages typically abstract over some aspects of the way in …

Cloud-aware data intensive workflow scheduling on volunteer computing systems

T Ghafarian, B Javadi - Future Generation Computer Systems, 2015 - Elsevier
Volunteer computing systems offer high computing power to the scientific communities to run
large data intensive scientific workflows. However, these computing environments provide …

Dynamic and fault-tolerant clustering for scientific workflows

W Chen, RF da Silva, E Deelman… - IEEE Transactions on …, 2015 - ieeexplore.ieee.org
Task clustering has proven to be an effective method to reduce execution overhead and to
improve the computational granularity of scientific workflow tasks executing on distributed …

Efficient provenance storage over nested data collections

MK Anand, S Bowers, T McPhillips… - Proceedings of the 12th …, 2009 - dl.acm.org
Scientific workflow systems are increasingly used to automate complex data analyses,
largely due to their benefits over traditional approaches for workflow design, optimization …

Resource optimization for parallel data integration

SD Harris, X Pu - US Patent 8,935,702, 2015 - Google Patents
For optimizing resources for a parallel data integration job, a job request is received, which
specifies a parallel data inte gration job to deploy in a grid. Grid resource utilizations are …

Fault tolerance for a scientific workflow system in a cloud computing environment

M Khaldi, M Rebbah, B Meftah… - International Journal of …, 2020 - Taylor & Francis
High computation power is required to execute complex scientific workflows. Cloud
computing resources are used viably to perform such complex workflows. Task clustering …

Overhead analysis of scientific workflows in grid environments

R Prodan, T Fahringer - IEEE Transactions on parallel and …, 2008 - ieeexplore.ieee.org
Scientific workflows are a topic of great interest in the grid community that sees in the
workflow model an attractive paradigm for programming distributed wide-area grid …

Integration of workflow partitioning and resource provisioning

W Chen, E Deelman - … Symposium on Cluster, Cloud and Grid …, 2012 - ieeexplore.ieee.org
The recent increased use of workflow management systems by large scientific
collaborations presents the challenge of scheduling large-scale workflows onto distributed …

Partitioning and scheduling workflows across multiple sites with storage constraints

W Chen, E Deelman - Parallel Processing and Applied Mathematics: 9th …, 2012 - Springer
This paper aims to address the problem of scheduling large workflows onto multiple
execution sites with storage constraints. Three heuristics are proposed to first partition the …

Performance analysis of dynamic workflow scheduling in multicluster grids

O Sonmez, N Yigitbasi, S Abrishami, A Iosup… - Proceedings of the 19th …, 2010 - dl.acm.org
Scientists increasingly rely on the execution of workflows in grids to obtain results from
complex mixtures of applications. However, the inherently dynamic nature of grid workflow …