Cold start latency mitigation mechanisms in serverless computing: taxonomy, review, and future directions
A Ebrahimi, M Ghobaei-Arani, H Saboohi - Journal of Systems Architecture, 2024 - Elsevier
Abstract Today, Function-as-a-Service (FaaS), as an emerging path to implementing
serverless computing paradigm, seems quite promising in responding to the growing …
serverless computing paradigm, seems quite promising in responding to the growing …
Help rather than recycle: Alleviating cold startup in serverless computing through {Inter-Function} container sharing
In serverless computing, each function invocation is executed in a container (or a Virtual
Machine), and container cold startup results in long response latency. We observe that some …
Machine), and container cold startup results in long response latency. We observe that some …
Tetris: Memory-efficient serverless inference through tensor sharing
Executing complex, memory-intensive deep learning inference services poses a major
challenge for serverless computing frameworks, which would densely deploy and maintain …
challenge for serverless computing frameworks, which would densely deploy and maintain …
Aquatope: Qos-and-uncertainty-aware resource management for multi-stage serverless workflows
Multi-stage serverless applications, ie, workflows with many computation and I/O stages, are
becoming increasingly representative of FaaS platforms. Despite their advantages in terms …
becoming increasingly representative of FaaS platforms. Despite their advantages in terms …
Asyfunc: A high-performance and resource-efficient serverless inference system via asymmetric functions
Recent advances in deep learning (DL) have spawned various intelligent cloud services
with well-trained DL models. Nevertheless, it is nontrivial to maintain the desired end-to-end …
with well-trained DL models. Nevertheless, it is nontrivial to maintain the desired end-to-end …
Mxfaas: Resource sharing in serverless environments for parallelism and efficiency
Although serverless computing is a popular paradigm, current serverless environments have
high overheads. Recently, it has been shown that serverless workloads frequently exhibit …
high overheads. Recently, it has been shown that serverless workloads frequently exhibit …
ProPack: Executing Concurrent Serverless Functions Faster and Cheaper
The serverless computing model has been on the rise in recent years due to a lower barrier
to entry and elastic scalability. However, our experimental evidence suggests that multiple …
to entry and elastic scalability. However, our experimental evidence suggests that multiple …
Daydream: Executing dynamic scientific workflows on serverless platforms with hot starts
HPC applications are increasingly being designed as dynamic workflows for the ease of
development and scaling. This work demonstrates how the serverless computing model can …
development and scaling. This work demonstrates how the serverless computing model can …
Memento: architectural support for ephemeral memory management in serverless environments
Serverless computing is an increasingly attractive paradigm in the cloud due to its ease of
use and fine-grained pay-for-what-you-use billing. However, serverless computing poses …
use and fine-grained pay-for-what-you-use billing. However, serverless computing poses …
Xfaas: Hyperscale and low cost serverless functions at meta
A Sahraei, S Demetriou, A Sobhgol, H Zhang… - Proceedings of the 29th …, 2023 - dl.acm.org
Function-as-a-Service (FaaS) has become a popular programming paradigm in Serverless
Computing. As the responsibility of resource provisioning shifts from users to cloud …
Computing. As the responsibility of resource provisioning shifts from users to cloud …