Software Development
Prefix Cache Replay
Replay an LLM inference request trace (Mooncake / vLLM / SGLang hash_ids format) against a block-level KV prefix cache and compute hit statistics. Use when given a request trace plus cache configuration and asked for hit rate, hit tokens, or final cache contents. Covers the longest-contiguous-prefix semantics that distinguishes KV prefix caching from full-prompt prompt caching, the policy-specific residency and eviction rules (LRU, LFU, S3FIFO), and the partial-last-block accounting rule.
- Publisher / source
- benchflow-ai/skillsbench (found on GitHub top repositories)
- Upstream record
- benchflow-ai/skillsbench
- Version
- Version 1
- Published
- Publication review
- Approved for publication · recorded passed scan 2026-11-07
- Content fingerprint
28ced940ec272cc01cf06519912077492d948b10e08a933acba12dd9907220cf