marella/ctransformers

Python bindings for llama.cpp

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

A fast inference library for running LLMs locally on modern consumer-class GPUs

High-speed Large Language Model Serving for Local Deployment

Run PyTorch LLMs locally on servers, desktop and mobile

The official PyTorch implementation of Google's Gemma models

Implementation for MatMul-free LM.

lightweight, standalone C++ inference engine for Google's Gemma models.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.