karminski/PromptXRay

Improve Pi prompt/KV cache hit rates with stable prompts, OpenAI-compatible cache keys, proxy compat warnings, and footer cache stats.

LLM proxy specialized in analyzing harness traffic to catch cache invalidation.

🚀 Autocache - Intelligent Anthropic API Cache Proxy Automatically inject cache-control fields into Claude API requests to reduce costs by up to 90% and latency by up to 85%. Works as a transparent drop-in replacement for popular AI platforms like n8n, Flowise, Make.com, LangChain, and LlamaIndex—no code changes required

Drop-in prompt-caching fixes for the LLM agent harness you use. Point your AI coding agent at this repo and it ships the patches.

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

See what your coding agent (Claude Code, Codex, Kimi) sends to the model — local proxy + web dashboard

API proxy for calling endpoints using `agent` cli from Cursor

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓