linkedin/Liger-Kernel

PyTorch native post-training library

Accessible large language models via k-bit quantization for PyTorch.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

DeepGEMM: clean and efficient BLAS kernel library on GPU

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

AirLLM 70B inference with single 4GB GPU

FlashInfer: Kernel Library for LLM Serving

LLM training code for Databricks foundation models