Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers
Like tpurtell/ds41rt, 0 likes 0 Bookmark tpurtell/ds41rt, 0 bookmarks 0 DeepSeek-V4.1-Flash EXL3 on one 24 GB RTX 3090 + DDR4 + NVMe: staged-DMA prefill, AVX2 CPU expert tier, elastic VRAM expert cache, Engram on disk, OpenAI API
Like sybil-solutions/dsv41-flash-offload, 0 likes 0 Bookmark sybil-solutions/dsv41-flash-offload, 0 bookmarks 0 Entrpi/ds4, a Blackwell CUDA perf fork of antirez/ds4 on NVIDIA DGX Spark: one-command install, ~3x upstream prefill, ~1.5x decode, DSpark, and full continuous batch support
Like Entrpi/ds4-on-spark, 0 likes 0 Bookmark Entrpi/ds4-on-spark, 0 bookmarks 0 DeepSeek 4 Flash local inference engine for Metal and CUDA with M5 optimizations.
Like Swival/ds4-m5, 0 likes 0 Bookmark Swival/ds4-m5, 0 bookmarks 0 Experimental implementation of DeepSeek v4 flaash in llama.cpp
Like Fringe210/llama.cpp-deepseek-v4-flash-cuda, 0 likes 0 Bookmark Fringe210/llama.cpp-deepseek-v4-flash-cuda, 0 bookmarks 0 CUDA Blackwell performance fork of antirez/ds4 (DeepSeek-V4-Flash): ~4x prefill, ~1.5x decode, continuous batching, weight server, DSpark
Like Entrpi/ds4, 0 likes 0 Bookmark Entrpi/ds4, 0 bookmarks 0 DeepSeek V4.1 Flash on 4x RTX PRO 6000 Blackwell: native weights, DSpark, vision, NVMe or locked RAM Engram offload.
Like sybil-solutions/deepseek-v4.1-flash-4x-rtx-pro-6000, 0 likes 0 Bookmark sybil-solutions/deepseek-v4.1-flash-4x-rtx-pro-6000, 0 bookmarks 0 DeepSeek v4.1 Flash EXL3 2.9 bpw for 2x DGX Sparks
Like MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-Sparks, 0 likes 0 Bookmark MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-Sparks, 0 bookmarks 0