foundation-model-stack/foundation-model-stack

PyTorch native post-training library

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

PyTorch building blocks for the OLMo ecosystem

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

LLM training code for Databricks foundation models

Modalities, a PyTorch-native framework for distributed and reproducible foundation model training.

Scale LLM Engine public repository