LumosJiang/Awesome-On-Device-LLMs

Awesome Mobile LLMs

Awesome LLM compression research papers and tools.

Language models running locally on hardware that has no business running them

Curated list of papers, frameworks, benchmarks, and applications for multimodal AI agents (LLMs, text-to-image, speech, world models, etc.) on mobile and edge devices.

A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally

[ICLR-2025-SLLM Spotlight 🔥]MobiLlama : Small Language Model tailored for edge devices

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

A curated list of awesome edge machine learning resources, including research papers, inference engines, challenges, books, meetups and others.