jeho-lee/Awesome-On-Device-AI-Systems

A curated list of awesome edge machine learning resources, including research papers, inference engines, challenges, books, meetups and others.

Awesome Mobile LLMs

A carefully curated collection of high-quality libraries, projects, tutorials, research papers, and other essential resources focused on TinyML — the intersection of machine learning and ultra-low-power embedded systems.

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

On-device AI across mobile, embedded and edge for PyTorch

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

A curated list of awesome edge computing, including Frameworks, Simulators, Tools, etc.