A large-scale analysis of hundreds of in-memory key-value cache clusters at twitter

J Yang, Y Yue, KV Rashmi - ACM Transactions on Storage (TOS), 2021 - dl.acm.org
Modern web services use in-memory caching extensively to increase throughput and reduce
latency. There have been several workload analyses of production systems that have fueled …

FIFO queues are all you need for cache eviction

J Yang, Y Zhang, Z Qiu, Y Yue, R Vinayak - Proceedings of the 29th …, 2023 - dl.acm.org
As a cache eviction algorithm, FIFO has a lot of attractive properties, such as simplicity,
speed, scalability, and flash-friendliness. The most prominent criticism of FIFO is its low …

{SIEVE} is Simpler than {LRU}: an Efficient {Turn-Key} Eviction Algorithm for Web Caches

Y Zhang, J Yang, Y Yue, Y Vigfusson… - 21st USENIX Symposium …, 2024 - usenix.org
Caching is an indispensable technique for low-cost and fast data serving. The eviction
algorithm, at the heart of a cache, has been primarily designed to maximize efficiency …

{OSCA}: An {Online-Model} Based Cache Allocation Scheme in Cloud Block Storage Systems

Y Zhang, P Huang, K Zhou, H Wang, J Hu, Y Ji… - 2020 USENIX Annual …, 2020 - usenix.org
We propose an Online-Model based Scheme for Cache Allocation for shared cache servers
among cloud block storage devices. OSCA can find a near-optimal configuration scheme at …

{SHADE}: Enable Fundamental Cacheability for Distributed Deep Learning Training

RIS Khan, AH Yazdani, Y Fu, AK Paul, B Ji… - … USENIX Conference on …, 2023 - usenix.org
Deep learning training (DLT) applications exhibit unique I/O workload behaviors that pose
new challenges for storage system design. DLT is I/O intensive since data samples need to …

Exploration and exploitation for buffer-controlled HDD-Writes for SSD-HDD hybrid storage server

S Wang, Z Lu, Q Cao, H Jiang, J Yao, Y Dong… - ACM Transactions on …, 2022 - dl.acm.org
Hybrid storage servers combining solid-state drives (SSDs) and hard-drive disks (HDDs)
provide cost-effectiveness and μs-level responsiveness for applications. However …

Het-kg: Communication-efficient knowledge graph embedding training via hotness-aware cache

S Dong, X Miao, P Liu, X Wang… - 2022 IEEE 38th …, 2022 - ieeexplore.ieee.org
With the popularization and application of Artificial Intelligence technology, knowledge
graph embedding methods are widely used for a variety of machine learning tasks …

A delayed eviction caching replacement strategy with unified standard for edge servers

P Li, Y Zhang, H Zhang, W Wang, K Xu, Z Zhang - Computer Networks, 2023 - Elsevier
The current explosion of user traffic compels Internet service providers to cache contents at
edge servers, so as to reduce the response time of user requests. To deal with such vast …

Efficient SSD cache for cloud block storage via leveraging block reuse distances

K Zhou, Y Zhang, P Huang, H Wang, Y Ji… - … on Parallel and …, 2020 - ieeexplore.ieee.org
Solid State Drives (SSDs) are popularly used for caching in large scale cloud storage
systems nowadays. Traditionally, most cache algorithms make replacement upon each miss …

SS-LRU: a smart segmented LRU caching

C Li, M Wu, Y Liu, K Zhou, J Zhang, Y Sun - Proceedings of the 59th …, 2022 - dl.acm.org
Many caching policies use machine learning to predict data reuse, but they ignore the
impact of incorrect prediction on cache performance, especially for large-size objects. In this …