loomax-labs/InferrLM

Language Model Playground

A mobile application designed to provide a beautiful, fast, and privacy-respecting interface for on device LLM and local LLM servers and cloud providers

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source

Run PyTorch LLMs locally on servers, desktop and mobile

An app that brings language models directly to your phone.

llama and other large language models on iOS and MacOS offline using GGML library.

A frontend for running models on mobile or connecting to your preferred API providers.

chat with private and local large language models