zipnn/zipnn

A safetensors extension to efficiently store sparse quantized tensors on disk

For releasing code related to compression methods for transformers, accompanying our publications

Python package for LLM compression

State-of-the-art LLM compression, built for production inference with vLLM

LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.

Simple, safe way to store and distribute tensors

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.