Caching with delayed hits

N Atre, J Sherry, W Wang, DS Berger - … of the Annual conference of the …, 2020 - dl.acm.org
Caches are at the heart of latency-sensitive systems. In this paper, we identify a growing
challenge for the design of latency-minimizing caches called delayed hits. Delayed hits …

Towards latency awareness for content delivery network caching

G Yan, J Li - 2022 USENIX Annual Technical Conference (USENIX …, 2022 - usenix.org
Caches are pervasively used in content delivery networks (CDNs) to serve requests close to
users and thus reduce content access latency. However, designing latency-optimal caches …

Online file caching in latency-sensitive systems with delayed hits and bypassing

C Zhang, H Tan, G Li, Z Han… - IEEE INFOCOM 2022 …, 2022 - ieeexplore.ieee.org
In latency-sensitive file caching systems such as Content Delivery Networks (CDNs) and
Mobile Edge Computing (MEC), the latency of fetching a missing file to the local cache can …

Online Container Caching with Late-Warm for IoT Data Processing

G Li, H Tan, X Zhang, C Zhang, R Zhou… - 2024 IEEE 40th …, 2024 - ieeexplore.ieee.org
Serverless edge computing is an efficient way to execute event-driven, short-duration, and
bursty IoT data processing tasks on resource-limited edge servers, using on-demand …

The Influence of Delayed-hit on Caching Servers Utilizing Conventional Cache Replacement Methods

F Fahrianto, N Kamiyama - 2023 11th International Conference …, 2023 - ieeexplore.ieee.org
A caching system implemented through online methods like Content Delivery Network
(CDN), Proxy, Gateway, or Information-centric Networking (ICN) router is utilized to improve …

On Latency Awareness with Delayed Hits

G Einziger, N Keren, G Scalosub - Proceedings of the 16th ACM …, 2023 - dl.acm.org
We consider a new locality pattern in the form of burstiness to improve cache effectiveness
in workflows where items are requested in possibly infrequent yet costly batches. Adding a …

On Latency Aware Caching with Delayed Hits

G Einziger, N Keren, G Scalosub - Association for Computing Machinery, 2023 - dl.acm.org
We consider a new locality pattern in the form of burstiness to improve cache effectiveness
in workflows where items are requested in possibly infrequent yet costly batches. Adding a …