DeepSeek 4 Flash local inference engine for Metal and CUDA with M5 optimizations.
Like Swival/ds4-m5, 0 likes 0 Bookmark Swival/ds4-m5, 0 bookmarks 0 DeepSeek-V4.1-Flash-1017 (552B MoE) on 2x RTX 3090 + 128 GB RAM: Rust + CUDA engine and 2-bit quant. 30-37 tok/s decode.
Like lxe/dsx, 0 likes 0 Bookmark lxe/dsx, 0 bookmarks 0 DeepSeek V4 Flash CPU/NVMe research fork: 78.62 GiB GGUF validated on 7.7 GiB RAM, CPU-only, using demand paging.
Like baker27727/ds4-8gb-cpu, 0 likes 0 Bookmark baker27727/ds4-8gb-cpu, 0 bookmarks 0 Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support
Like Entrpi/ds4-on-spark, 0 likes 0 Bookmark Entrpi/ds4-on-spark, 0 bookmarks 0 DeepSeek V4.1 Flash on 4x RTX PRO 6000 Blackwell: native weights, DSpark, vision, NVMe or locked RAM Engram offload.
Like sybil-solutions/deepseek-v4.1-flash-4x-rtx-pro-6000, 0 likes 0 Bookmark sybil-solutions/deepseek-v4.1-flash-4x-rtx-pro-6000, 0 bookmarks 0 CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark
Like Entrpi/ds4, 0 likes 0 Bookmark Entrpi/ds4, 0 bookmarks 0 Run DeepSeek-V4.1-Flash / DeepSeek-V4-Flash and GLM-5.3-Flash on SM89 (Ada / RTX 4090) and SM120 (RTX PRO 6000) with vLLM
Like yhfgyyf/vllm-deepseek-v4-sm89, 0 likes 0 Bookmark yhfgyyf/vllm-deepseek-v4-sm89, 0 bookmarks 0 Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers
Like tpurtell/ds41rt, 0 likes 0 Bookmark tpurtell/ds41rt, 0 bookmarks 0