Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers
Like tpurtell/ds41rt, 0 likes 0 Bookmark tpurtell/ds41rt, 0 bookmarks 0 Uncensored DeepSeek-V4.1-Flash IQ2_XS on Google Colab
Like leonxger/deepseek-colab, 0 likes 0 Bookmark leonxger/deepseek-colab, 0 bookmarks 0 Run DeepSeek-V4.1-Flash / DeepSeek-V4-Flash and GLM-5.3-Flash on SM89 (Ada / RTX 4090) and SM120 (RTX PRO 6000) with vLLM
Like yhfgyyf/vllm-deepseek-v4-sm89, 0 likes 0 Bookmark yhfgyyf/vllm-deepseek-v4-sm89, 0 bookmarks 0 DeepSeek-V4.1-Flash EXL3 on one 24 GB RTX 3090 + DDR4 + NVMe: staged-DMA prefill, AVX2 CPU expert tier, elastic VRAM expert cache, Engram on disk, OpenAI API
Like sybil-solutions/dsv41-flash-offload, 0 likes 0 Bookmark sybil-solutions/dsv41-flash-offload, 0 bookmarks 0 DeepSeek V4.1 Flash on 4x RTX PRO 6000 Blackwell: native weights, DSpark, vision, NVMe or locked RAM Engram offload.
Like sybil-solutions/deepseek-v4.1-flash-4x-rtx-pro-6000, 0 likes 0 Bookmark sybil-solutions/deepseek-v4.1-flash-4x-rtx-pro-6000, 0 bookmarks 0 DeepSeek v4.1 Flash EXL3 2.9 bpw for 2x DGX Sparks
Like MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-Sparks, 0 likes 0 Bookmark MiaAI-Lab/DeepSeek-v4.1-Flash-EXL3-2x-DGX-Sparks, 0 bookmarks 0 DeepSeek-V4.1-Flash-1017 EXL3 2.9bpw on 2x NVIDIA DGX Spark (GB10) with TensorFold: 2.1-2.3x the vLLM kit's decode speed.
Like Elevatormusic/DeepSeek-V4.1-Flash-1017-EXL3-TensorFold-2x-DGX-Spark, 0 likes 0 Bookmark Elevatormusic/DeepSeek-V4.1-Flash-1017-EXL3-TensorFold-2x-DGX-Spark, 0 bookmarks 0 DeepSeek-V4-Flash-DSpark optimized vLLM 0.26.0 SM121 dual-GB10 evidence (NVFP4 KV, B12X, DSpark K6)
Like r0b0tlab/DeepSeek-V4-Flash-DSpark-v026-SM121, 0 likes 0 Bookmark r0b0tlab/DeepSeek-V4-Flash-DSpark-v026-SM121, 0 bookmarks 0 DeepSeek-V4.1-Flash on 4× NVIDIA CMP 170HX with vLLM: up to 297 tok/s for one user, up to 868 tok/s at eight, 262K context, one-command container install
Like Morrowmake/dsv41-flash-cmp170hx-recipe, 0 likes 0 Bookmark Morrowmake/dsv41-flash-cmp170hx-recipe, 0 bookmarks 0