Qwen3.8-Flash-Next IQ3_S on 12 GB VRAM + 32 GB RAM + NVMe: ~45-50 tok/s decode, 131k context, Strata unify fork
Like bodhi37/Qwen3.8-Flash-12GBRAM-32GBVRAM-SSD-Recipe, 0 likes 0 Bookmark bodhi37/Qwen3.8-Flash-12GBRAM-32GBVRAM-SSD-Recipe, 0 bookmarks 0 Run Qwen3.8-Flash-Next (180B) on a single DGX Spark by keeping its 51B n-gram embedding table on NVMe
Like 0xBakeer/qwen38-flash-next-spark, 0 likes 0 Bookmark 0xBakeer/qwen38-flash-next-spark, 0 bookmarks 0 Verified Qwen3.8 Flash-Next GGUF recipe for one NVIDIA DGX Spark or ASUS Ascent GX10
Like sxuff/qwen38-flash-next-dgx-spark, 0 likes 0 Bookmark sxuff/qwen38-flash-next-dgx-spark, 0 bookmarks 0 Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,865 tok/s; with 64 GB RAM 3,410 tok/s prefill · 84 tok/s decode. New: opt-in uncensored mode (runtime abliteration, no new weights).
Like DominikBucko/qwen38-flash-next-2x3090, 0 likes 0 Bookmark DominikBucko/qwen38-flash-next-2x3090, 0 bookmarks 0 qwen38-flash-next recipe for solo GB10
Like myllmbox/qwen38-flash-next-recipe, 0 likes 0 Bookmark myllmbox/qwen38-flash-next-recipe, 0 bookmarks 0 recipe for running Qwen3.8-Flash-Next on a single DGX Spark
Like blazux/qwen3.8-Flash-DGX, 0 likes 0 Bookmark blazux/qwen3.8-Flash-DGX, 0 bookmarks 0 recipe for running Qwen3.8-Flash-Next on a single DGX Spark (fork)
Like Saren-Arterius/qwen3.8-Flash-DGX-AutoRound, 0 likes 0 Bookmark Saren-Arterius/qwen3.8-Flash-DGX-AutoRound, 0 bookmarks 0 RTX 6000 96GB/Spark 128GB vLLM Recipe for Qwen 3.8 Flash Next
Like tpurtell/sm12x-exl3-qwen3.8-flash-next, 0 likes 0 Bookmark tpurtell/sm12x-exl3-qwen3.8-flash-next, 0 bookmarks 0 Strata fork: Qwen3.8-Flash-Next 125B MoE in NVFP4 on one RTX 20-50 card (12 GB+) and 64 GB of RAM or more. Setup installs our GPTQ quants (huihui abliterated, OrcaRouter) from Hugging Face. CPU experts on AVX-512 or AVX2 (+AVX-VNNI), all experts in RAM from 92 GB, a low-RAM mode below, vision, W4A8 prompts. Windows / CUDA 13.
Like sergqwer/strata-nvfp4, 0 likes 0 Bookmark sergqwer/strata-nvfp4, 0 bookmarks 0