rohaquinlop/pi-deepseek-cache

Improve Pi prompt/KV cache hit rates with stable prompts, OpenAI-compatible cache keys, proxy compat warnings, and footer cache stats.

Drop-in OpenAI-compatible cache that replays repeated computer-use and agent workflows at near-zero cost.

Keep Claude Code’s prompt cache warm during breaks and show the estimated cost before a cold send.

A reverse proxy server to cache the slow expensive requests to the openai api. Built with nginx and docker.

Drop-in prompt-caching fixes for the LLM agent harness you use. Point your AI coding agent at this repo and it ships the patches.

Agent 始终无法命中缓存巨浪费Token? 来看 PromptXRay! PromptXRay 是一个代理工具，只需要接入到AI API 调用中间, 就可以分析 OpenAI 兼容API的 Prompt 缓存行为

Pi compaction that reuses the server's prefix cache (vLLM / SGLang / llama.cpp Anthropic endpoints): no cold re-prefill, plus a warm-up so the next turn starts from cache

Smart OpenAI‑compatible proxy for llama.cpp: manages slots, saves/restores KV cache to disk, routes requests by prefix similarity, and protects hot slots from being overwritten. Accelerates long prompts (30–60k tokens) via instant reuse or fast on‑demand restore; supports SSE streaming and non‑stream JSON over /v1/chat/completions.