Cold start latency mitigation mechanisms in serverless computing: taxonomy, review, and future directions

A Ebrahimi, M Ghobaei-Arani, H Saboohi - Journal of Systems Architecture, 2024 - Elsevier
Abstract Today, Function-as-a-Service (FaaS), as an emerging path to implementing
serverless computing paradigm, seems quite promising in responding to the growing …

Help rather than recycle: Alleviating cold startup in serverless computing through {Inter-Function} container sharing

Z Li, L Guo, Q Chen, J Cheng, C Xu, D Zeng… - 2022 USENIX Annual …, 2022 - usenix.org
In serverless computing, each function invocation is executed in a container (or a Virtual
Machine), and container cold startup results in long response latency. We observe that some …

Tetris: Memory-efficient serverless inference through tensor sharing

J Li, L Zhao, Y Yang, K Zhan, K Li - 2022 USENIX Annual Technical …, 2022 - usenix.org
Executing complex, memory-intensive deep learning inference services poses a major
challenge for serverless computing frameworks, which would densely deploy and maintain …

Aquatope: Qos-and-uncertainty-aware resource management for multi-stage serverless workflows

Z Zhou, Y Zhang, C Delimitrou - Proceedings of the 28th ACM …, 2022 - dl.acm.org
Multi-stage serverless applications, ie, workflows with many computation and I/O stages, are
becoming increasingly representative of FaaS platforms. Despite their advantages in terms …

Asyfunc: A high-performance and resource-efficient serverless inference system via asymmetric functions

Q Pei, Y Yuan, H Hu, Q Chen, F Liu - … of the 2023 ACM Symposium on …, 2023 - dl.acm.org
Recent advances in deep learning (DL) have spawned various intelligent cloud services
with well-trained DL models. Nevertheless, it is nontrivial to maintain the desired end-to-end …

Mxfaas: Resource sharing in serverless environments for parallelism and efficiency

J Stojkovic, T Xu, H Franke, J Torrellas - Proceedings of the 50th Annual …, 2023 - dl.acm.org
Although serverless computing is a popular paradigm, current serverless environments have
high overheads. Recently, it has been shown that serverless workloads frequently exhibit …

ProPack: Executing Concurrent Serverless Functions Faster and Cheaper

R Basu Roy, T Patel, R Liew, YN Babuji… - Proceedings of the …, 2023 - dl.acm.org
The serverless computing model has been on the rise in recent years due to a lower barrier
to entry and elastic scalability. However, our experimental evidence suggests that multiple …

Daydream: Executing dynamic scientific workflows on serverless platforms with hot starts

RB Roy, T Patel, D Tiwari - SC22: International Conference for …, 2022 - ieeexplore.ieee.org
HPC applications are increasingly being designed as dynamic workflows for the ease of
development and scaling. This work demonstrates how the serverless computing model can …

Memento: architectural support for ephemeral memory management in serverless environments

Z Wang, K Zhao, P Li, A Jacob, M Kozuch… - Proceedings of the 56th …, 2023 - dl.acm.org
Serverless computing is an increasingly attractive paradigm in the cloud due to its ease of
use and fine-grained pay-for-what-you-use billing. However, serverless computing poses …

Xfaas: Hyperscale and low cost serverless functions at meta

A Sahraei, S Demetriou, A Sobhgol, H Zhang… - Proceedings of the 29th …, 2023 - dl.acm.org
Function-as-a-Service (FaaS) has become a popular programming paradigm in Serverless
Computing. As the responsibility of resource provisioning shifts from users to cloud …