stevelaskaridis/awesome-mobile-llm

[ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

Fast Multimodal LLM on Mobile Devices

list of awesome platforms, tools, and resources run for LLMs locally

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

MiniCPM5: SOTA on-device LLMs, small yet powerful.

Demonstration of running a native LLM on Android device.

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

Run 35B MoE models in ~2.5 GB of RAM. Weights stream from SSD; a trained router predicts loads a step ahead. Mac, iPhone, Android, Windows supported