freeai-org/Scalpel

This is our own implementation of 'Layer Selective Rank Reduction'

Prune transformer layers

Recipes for shrinking, optimizing, customizing cutting edge vision models. 💜

Export utility for unconstrained channel pruned models

The official implementation of the paper "Uncovering the Redundancy in Transformers via a Unified Study of Layer Dropping (TMLR)".

Everything about the SmolLM and SmolVLM family of models

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

For releasing code related to compression methods for transformers, accompanying our publications

State-of-the-art LLM compression, built for production inference with vLLM