ngxson/wllama

High-performance In-browser LLM Inference Engine

Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser

a fast cross platform AI inference engine 🤖 using Rust 🦀 and WebGPU 🎮

Python bindings for llama.cpp

💬 A proposal for a web API for prompting browser-provided language models

Universal LLM Deployment Engine with ML Compilation

LLM inference in C/C++

A cross-platform browser ML framework.

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!