lukaLLM/DFlash2_Qwen3.8_3.6_27B_LlamaCPP

llama.cpp speculative decoding measured on one RTX 3090, Qwen3.6-35B-A3B UD-Q4_K_XL, commit 3737e4137. Published figures are re-derived from the committed data by a checker that fails on drift, a coverage probe reports how many of them it actually covers, and ERRATA.md lists this study's own retracted claims.

Speculative decoding has plenty of tricks. Which ones actually make LLMs faster? Explore 7 methods, 26 checkpoints, and a shared training and evaluation framework.

DFlash: Block Diffusion for Flash Speculative Decoding

DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms

[COLMW'26 Spotlight] AdaFlash: Adaptive Speculative Decoding via On-Policy Distilled Diffusion Drafters

One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, paired benchmarks, probe tool.

Official Implementation for DLite

Qwen3.8-27B EXL3 (4.00 bpw) + DFlash2 speculative decoding for ExLlamaV3, validated at 262k context on a 24 GB RTX 3090

Qwen3.8-27B on one DGX Spark: SGLang + DFlash2 recipe, engine image, benchmarks, data and charts. By @redp314