Emericen/tiny-qwen

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

Qwen3.8-27B on 16-32 GB Nvidia GPUs one-click install for Windows / Linux

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

Accessible large language models via k-bit quantization for PyTorch.

Qwen3.8 is the large language model series developed by Qwen team, Alibaba Group.

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

Perplexity open source garden for inference technology

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.