🚀 DeepSeek 又整活了！ 刚刚发布 DSpark —— 一种新的 Confidence-Scheduled 推测解码方法！ 针对 DeepSeek-V4 Flash & Pro，吞吐量直接拉升 51%~400%！ 更猛的是，它在 Gemma、Qwen 等其他开源模型上也表现优秀。 这意味着以后跑大模型能更快、更便宜了。

new inference optimization method by @deepseek_ai with an extremely detailed paper, draft model and framework to train them. results in production for dsv4 lead to +50% for throughput and latency…

Not New DeepSeek-V4-Pro-DSpark Oblig @teortaxesTex Note: DeepSeek-V4-Pro-DSpark is not a new model. It is the same checkpoint with an additional speculative decoding module attached.