Daydream: Executing dynamic scientific workflows on serverless platforms with hot starts

RB Roy, T Patel, D Tiwari - SC22: International Conference for …, 2022 - ieeexplore.ieee.org
HPC applications are increasingly being designed as dynamic workflows for the ease of
development and scaling. This work demonstrates how the serverless computing model can …

Mashup: making serverless computing useful for hpc workflows via hybrid execution

RB Roy, T Patel, V Gadepally, D Tiwari - Proceedings of the 27th ACM …, 2022 - dl.acm.org
This work introduces Mashup, a novel strategy to leverage serverless computing model for
executing scientific workflows in a hybrid fashion by taking advantage of both the traditional …

Sweep: Accelerating scientific research through scalable serverless workflows

A John, K Ausmees, K Muenzen, C Kuhn… - Proceedings of the 12th …, 2019 - dl.acm.org
Scientific and commercial applications are increasingly being executed in the cloud, but the
difficulties associated with cluster management render on-demand resources inaccessible …

Accelerating scientific workflows on HPC platforms with in situ processing

TMA Do, L Pottier, O Yildiz, K Vahi… - 2022 22nd IEEE …, 2022 - ieeexplore.ieee.org
Scientific workflows drive most modern large-scale science breakthroughs by allowing
scientists to define their computations as a set of jobs executed in a given order based on …

Exaworks: Workflows for exascale

A Al-Saadi, DH Ahn, Y Babuji, K Chard… - … IEEE Workshop on …, 2021 - ieeexplore.ieee.org
Exascale computers will offer transformative capabilities to combine data-driven and
learning-based approaches with traditional simulation applications to accelerate scientific …

Reproducible and portable workflows for scientific computing and HPC in the cloud

P Vaillancourt, B Wineholt, B Barker… - … and Experience in …, 2020 - dl.acm.org
The increasing availability of cloud computing services for science has changed the way
scientific code can be developed, deployed, and run. Many modern scientific workflows are …

FirecREST: a RESTful API to HPC systems

FA Cruz, AJ Dabin, JP Dorsch… - 2020 IEEE/ACM …, 2020 - ieeexplore.ieee.org
As science gateways are becoming an increasingly popular digital interface for scientific
communities, it is important for High-Performance Computing centers to provide a modern …

Balsam: Automated scheduling and execution of dynamic, data-intensive hpc workflows

MA Salim, TD Uram, JT Childers, P Balaprakash… - arXiv preprint arXiv …, 2019 - arxiv.org
We introduce the Balsam service to manage high-throughput task scheduling and execution
on supercomputing systems. Balsam allows users to populate a task database with a variety …

[PDF][PDF] Towards Serverless Execution of Scientific Workflows-HyperFlow Case Study.

M Malawski - Works@ Sc, 2016 - researchgate.net
Scientific workflows consisting of a high number of dependent tasks represent an important
class of complex scientific applications. Recently, a new type of serverless infrastructures …

Serverless execution of scientific workflows: Experiments with hyperflow, aws lambda and google cloud functions

M Malawski, A Gajek, A Zima, B Balis… - Future Generation …, 2020 - Elsevier
Scientific workflows consisting of a high number of interdependent tasks represent an
important class of complex scientific applications. Recently, a new type of serverless …