theIvanR/lmstudio-unlocked-backend

NPU Ollama - An Ollama/OpenAI compatible API for Intel OpenVINO compatible computers

Run GreenBitAI's Quantized LLMs on Apple Devices with MLX

LLM Inference Engine for Metal, CUDA and Vulkan.

run a 27b local ai on your gaming gpu, rtx 3060 and up, radeon rx 6600 and up in beta, 8gb or more, linux and windows, one line to install

Make use of Intel Arc Series GPU to Run Ollama, StableDiffusion, Whisper and Open WebUI, for image generation, speech recognition and interaction with Large Language Models (LLM).

Qwen3.8-27B and Qwen3.6-35B-A3B local inference engine for Vulkan and Metal

Control panel for VLLM, Sglang, llama.cpp, exllamav3

~1300 line, minimal, extensible LLM inference engine built from scratch.

Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on different ports and loading/unloading them on demand