Easy control for Key-Value Constrained Generative LLM Inference(https://arxiv.org/abs/2402.06262)

SIEVE cache - lockfree, concurrent cache - faster and simpler than LRU

A comprehensive open-source cache trace dataset

Hardware-level security protocol for mitigating cache-based side-channel attacks.

Idle but not forgotten: usage-driven agent memory forgets the dormant skills you'll need next quarter; NicheMem's competitive ownership retains them exactly. Mechanism-level benchmark + verified theory (sibling of GAUSE).

HybridCacheSystem is a modern C++ framework for building high-performance, multi-layered cache systems. It supports both LRU and LFU caching strategies, allows combining them for hybrid setups, and provides a unified interface for cache management and customization.

Trace-driven research harness for KV-cache hierarchy policy evaluation in long-context LLM inference.

CLOCK replacement algorithm, an efficient, compact and concurrent alternative to LRU cache eviction policy.

An implementation of W-TinyLFU policy

A cross-platform C++20 header-only LRU cache library with sliding expiration support

Trace-driven simulator for learned KV Cache eviction on synthetic sparse block-level access traces

REAL: REtrieval-reAsoning and Logic-constructed Attention Behaviors for Long-Context KV Cache Compression

A cache eviction simulator implementing LRU, FIFO, and a custom Greedy eviction algorithm.