Entrpi/ds4

DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm

DeepSeek 4 Flash local inference engine for Metal

Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support

LLM inference in C/C++

LLM Inference Engine for Metal and CUDA.

A high-performance, GGUF-native Rust & CUDA inference engine optimized for cold-start latency and real-time 'System 1' agent decision loops.

High-speed Large Language Model Serving for Local Deployment

Run the full 2.78-trillion-parameter Kimi K3 model, DeepSeek V4.1 Flash or GLM-5.3-Flash beyond available RAM by streaming activated weights directly from NVMe. A dependency-free, embeddable C inference engine.

Zig INferenCe Engine — Local LLM inference on AMD GPUs and Apple Silicon