Featured
hanxiao/Qwen3.8-27B-UD-Q4_K_XL-L4
Serving Qwen3.8-27B (Unsloth UD-Q4_K_XL GGUF) at 23 tok/s over a 104,192-token context on a single NVIDIA L4 24GB, llama.cpp + MTP speculative decoding. One-command GCP provisioning, tuning sweep, quality verification, and a binary-searched context ceiling.
Shell
4
1
1 contributors
Apache License 2.0
Social mentions
Recent discussions about this repository across the web
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues