qxoticai/qxotic

Java AI application development framework (supports LLM-tool,skill; RAG; MCP; Agent-ReAct,Team-Agent). Compatible with java8 ~ java26. It can also be embedded in SpringBoot, jFinal, Vert.x, Quarkus, and other frameworks.

Camelid: a Rust-native local inference backend with evidence-gated model compatibility.

A high-performance inference engine for AI models

Open source inference engine that tunes its kernels on your hardware to find the fastest way to run each model. 2x faster than Ollama. Works on Apple Silicon, NVIDIA, AMD, Intel, or just a CPU.

Java Inference API for Onnx models

Production ready toolkit to run AI locally

Apple Silicon mlx with Zero Dependency Java

Local AI API Platform

Fast, flexible LLM inference