A large-scale analysis of hundreds of in-memory key-value cache clusters at twitter

J Yang, Y Yue, KV Rashmi - ACM Transactions on Storage (TOS), 2021 - dl.acm.org
Modern web services use in-memory caching extensively to increase throughput and reduce
latency. There have been several workload analyses of production systems that have fueled …

FIFO queues are all you need for cache eviction

J Yang, Y Zhang, Z Qiu, Y Yue, R Vinayak - Proceedings of the 29th …, 2023 - dl.acm.org
As a cache eviction algorithm, FIFO has a lot of attractive properties, such as simplicity,
speed, scalability, and flash-friendliness. The most prominent criticism of FIFO is its low …

{GL-Cache}: Group-level learning for efficient and high-performance caching

J Yang, Z Mao, Y Yue, KV Rashmi - 21st USENIX Conference on File …, 2023 - usenix.org
Web applications rely heavily on software caches to achieve low-latency, high-throughput
services. To adapt to changing workloads, three types of learned caches (learned evictions) …

Segcache: a memory-efficient and scalable in-memory key-value cache for small objects

J Yang, Y Yue, R Vinayak - 18th USENIX Symposium on Networked …, 2021 - usenix.org
Modern web applications heavily rely on in-memory key-value caches to deliver low-latency,
high-throughput services. In-memory caches store small objects of size in the range of 10s to …

FIFO can be Better than LRU: the Power of Lazy Promotion and Quick Demotion

J Yang, Z Qiu, Y Zhang, Y Yue, KV Rashmi - … of the 19th Workshop on Hot …, 2023 - dl.acm.org
LRU has been the basis of cache eviction algorithms for decades, with a plethora of
innovations on improving LRU's miss ratio and throughput. While it is well-known that FIFO …

{OSCA}: An {Online-Model} Based Cache Allocation Scheme in Cloud Block Storage Systems

Y Zhang, P Huang, K Zhou, H Wang, J Hu, Y Ji… - 2020 USENIX Annual …, 2020 - usenix.org
We propose an Online-Model based Scheme for Cache Allocation for shared cache servers
among cloud block storage devices. OSCA can find a near-optimal configuration scheme at …

Frozenhot cache: Rethinking cache management for modern hardware

Z Qiu, J Yang, J Zhang, C Li, X Ma, Q Chen… - Proceedings of the …, 2023 - dl.acm.org
Caching is crucial for accelerating data access, employed as a ubiquitous design in modern
systems at many parts of computer systems. With increasing core count, and shrinking …

Netco: Cache and i/o management for analytics over disaggregated stores

V Jalaparti, C Douglas, M Ghosh, A Agrawal… - Proceedings of the …, 2018 - dl.acm.org
We consider a common setting where storage is disaggregated from the compute in data-
parallel systems. Colocating caching tiers with the compute machines can reduce load on …

Challenges and opportunities of dnn model execution caching

GR Gilman, SS Ogden, RJ Walls, T Guo - Proceedings of the Workshop …, 2019 - dl.acm.org
We explore the opportunities and challenges of model execution caching, a nascent
research area that promises to improve the performance of cloud-based deep inference …

[PDF][PDF] Massive Files Prefetching Model Based on LSTM Neural Network with Cache Transaction Strategy.

D Zhu, Y Sun, X Li, R Qu, H Hu, S Dong… - … Materials & Continua, 2020 - cdn.techscience.cn
In distributed storage systems, file access efficiency has an important impact on the real-time
nature of information forensics. As a popular approach to improve file accessing efficiency …