tjake/Jlama

Llama 3+ inference in pure Java

Semantic Kernel for Java. Integrate cutting-edge LLM technology quickly and easily into your Java based apps. See https://aka.ms/semantic-kernel.

Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs

A simple Java library for interacting with Ollama server.

Fast Gemma 4 inference in pure Java

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

Apple Silicon mlx with Zero Dependency Java

The official Java library for the OpenAI API

LangChain4j integrations that are maintained by the community