google-ai-edge/litert-samples

The Qualcomm® AI Hub apps are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.

LiteRT, successor to TensorFlow Lite. is Google's On-device framework for high-performance ML & GenAI deployment on edge platforms, via efficient conversion, runtime, and optimization

Model export recipes, Python primitives, and Swift runtime utilities for on-device AI

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.

Support PyTorch model conversion with LiteRT.