mistralai/mistral-inference

Fast, flexible LLM inference

Official inference library for pre-processing of Mistral models

The official Meta Llama 3 GitHub site

High-speed Large Language Model Serving for Local Deployment

Run PyTorch LLMs locally on servers, desktop and mobile

LM Studio Apple MLX engine

Universal LLM Deployment Engine with ML Compilation

Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.