mbzuai-oryx/MobiLlama

MiniCPM5: SOTA on-device LLMs, small yet powerful.

Everything about the SmolLM and SmolVLM family of models

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

Big & Small LLMs working together

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

Runs 405B LLMs on 8GB VRAM

High-speed Large Language Model Serving for Local Deployment

Run PyTorch LLMs locally on servers, desktop and mobile