Flash-Next v2.5.1 is out: Qwen3.8-Flash-Next (125B MoE) on 4× RTX 3090, no NVLink. • Agent follow-ups resume from cache: 0.96 s to first token • 8 agents at once: 92.5 % cache reuse • 925K-token KV…

Further improved Running Qwen3.8 Flash-Next: Updated to vllm 0.30 Opt-in Repeatable greedy output Still 3 x 262k sessions running at once in the kv pool Opt-in GPU/NUMA auto-select for other box…

Usually tweet once in a blue moon to complain at a company. Deciding to shift gears. Finally managed to get Qwen3.8-Flash-Next running on 4x RTX 3090s: 807K KV pool, three full 262,144-token sessions…