mybigday/llama.rn

On-device LLM execution in React Native with Vercel AI SDK compatibility

🧬 High-performance TensorFlow Lite library for React Native with GPU acceleration

React Native binding of whisper.cpp.

Cross-platform on-device AI toolkit

High-performance, privacy-first on-device AI inference library for React Native, powered by PyTorch's ExecuTorch runtime

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

Run local LLMs like Gemma, Qwen, and LLaMA on Android for offline, private, real-time chat and question answering with LiteRT and ONNX Runtime.

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

Turn your Android phone into an OpenAI-compatible LLM inference server - Fully local, private and Open Source