AI & Machine Learning
KV Cache Design
优化 Agent 推理延迟与成本、诊断首 token 变慢或缓存命中率下降时使用——KV Cache 前缀不变性原则、三条铁律、五种破坏缓存的错误上下文管理模式、Chat Template 与历史思维链回传策略、缓存作为架构约束(缓存边界、子 Agent 字节级对齐、替换字符串冻结)。
- Publisher / source
- bojieli/ai-agent-book (found on GitHub top repositories)
- Upstream record
- bojieli/ai-agent-book
- Version
- Version 1
- Published
- Publication review
- Approved for publication · recorded passed scan 2026-11-03
- Content fingerprint
9e44bc53c0df2b0c24090331d5fc1c5d4717e63f241c2d213ac08ef57fd2bb3d