githubnext/localjev

Supersimple way to serve LLMs as a Jev-like endpoint

Turn any off-the-shelf LLM into a Jev -like decision layer

Local proxy that learns your app's typed LLM decisions and answers them with a Laya head. Jev and OpenAI compatible.

The open, local take on Jev: typed decisions from an LLM, without generating a single token

Native vLLM serving for Jev decision models

Turn local language models into Jev-style structured decision models. Get results from text and images with prefill alone—no token-by-token decoding required.

Open, Jev-compatible System One decision server on DiffusionGemma

Jev-compatible API server for open decision models. Ollama for decision models: pull and serve 29 model families (Laya, pplx-decider, Clef, Winnow, coba...) locally or self-hosted behind /v1/systemone. The TypeSafe SDK works unchanged: set its base URL and pick an open model. CLI, desktop app, Docker, MCP server, public bench.

Free open source alternative for Jev that supports text, documents and images and runs at ~2GB of ram on a CPU.