co-l/cache-hunter

Agent 始终无法命中缓存巨浪费Token? 来看 PromptXRay! PromptXRay 是一个代理工具，只需要接入到AI API 调用中间, 就可以分析 OpenAI 兼容API的 Prompt 缓存行为

A reverse proxy server to cache the slow expensive requests to the openai api. Built with nginx and docker.

Improve Pi prompt/KV cache hit rates with stable prompts, OpenAI-compatible cache keys, proxy compat warnings, and footer cache stats.

See what your coding agent (Claude Code, Codex, Kimi) sends to the model — local proxy + web dashboard

Model authenticity / dilution detection CLI: one command, one report. Detect fake or watered-down LLM endpoints via identity, context, tokenizer, capability and latency checks.

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

🚀 Autocache - Intelligent Anthropic API Cache Proxy Automatically inject cache-control fields into Claude API requests to reduce costs by up to 90% and latency by up to 85%. Works as a transparent drop-in replacement for popular AI platforms like n8n, Flowise, Make.com, LangChain, and LlamaIndex—no code changes required

A MITM proxy tool to intercept, analyze and log AI coding assistant (Claude Code, Open Code, etc.) communications with LLM APIs