<details open> sycl: scalar SWAR byte-subtract in Q6_K MMVQ dot product (22156) Signed-off-by: Chun Tao <[email protected]> Co-authored-by: Chun Tao <chun...

Big news for local models guy, MTP is in the master

MTP is finally merged in Llama.cpp, first test with Qwen3.6-35b on RTX 4060 Ti x1.5 t/sec!!!

So the Llama.cpp MTP finally made it through PR If you have not tried it yet, grab it and either of the primary qwen variants prepared by @UnslothAI with MTP support wonderful tk/s improvements await…

Llamacpp (9190) Inference on M5 (applegpu_g17s) <> M4 (applegpu_g16s) Here M5 run fails a test. Again temperature 0 and same server and evals used on M3 Ultra and M5 Max. llama-server -hf…

MTP finally merged onto main for llama.cpp (its been experimental + on a number of forks for a little bit) Somewhat notably, theres now some decent evidence that --spec-draft-n-max 3 outperforms w…

Giving Qwen3.6:27b a shot with the model token prediction (MTP) support that just shipped on llama.cpp This should be a significant speed-up over what I've been using currently. My AMD Radeon 9700s…

I nearly 2x'd the speed while only using +1GB VRAM with the new MTP update in llama.cpp 🤯 You need to add these flags to start using it: --spec-type draft-mtp \ --spec-draft-p-min 0.75 \…

Just got merged

The llama.cpp crowd are just testing now this PR! 😆 ITS MERGED!!!