arczhi/5060ti-qwen3.8-27b

HF CLI extension to run local coding agent powered by llmfit and llama.cpp

Linux & Powershell scripts to easily set up and run the Qwen 3.5 series locally on Windows and Linux with llama.cpp.

Optimized local serving engine for Kimi-Linear-48B: INT4 quantizer, fused decode kernels for a measured 3.18x, and an OpenAI-compatible server. Ships with k3, a bridge that detects the client per request so Claude Code, Codex, Cline, Aider and opencode all work unchanged.

Qwen3.8-27B on 16-32 GB Nvidia GPUs one-click install for Windows / Linux

Deployment kit: Qwen3.8-27B EXL3 3.5bpw target + DFlash2 EXL3 5.0bpw speculative draft — launcher, config, model cards

A minimal PyTorch re-implementation of Qwen 3.8

An offline coding agent for local models. One command sets up the best model your GPU can run, and on 24 GB+ RTX 30/40/50-series cards Qwen3.8-27B runs up to 1.9x faster than llama.cpp.

AI coding agent optimized for small LLMs. 87% benchmark with 4B-active model.

Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team.