google-ai-edge/LiteRT-LM

2k152

Gained this week

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

LaurieWired/tailslayer

2.1k113

Gained this week

Library for reducing tail latency in RAM reads

ggml-org/llama.cpp

1.8k296

Gained this week

LLM inference in C/C++

🦊 Anti-detect browser

Endee.io – A high-performance vector database, designed to handle up to 1B vectors on a single node, delivering significant performance gains through optimized indexing and execution. Also available in cloud https://endee.io/

Next-generation JavaScript analysis tooling

Private, fast, and honest web browser

Make a fortune quietly

Godot Engine – Multi-platform 2D and 3D game engine

A high-fidelity, open-source robotics simulator integrating Unreal Engine's photorealistic rendering with MuJoCo's precision physics.

Configure Logitech devices on Linux (Options+ clone)

LÖVE is an awesome 2D game framework for Lua.

An Open Source Machine Learning Framework for Everyone

LLM speculative inference server for heterogeneous hardware & consumer GPUs

A multi core friendly rigid body physics and collision detection library. Written in C++. Suitable for games and VR applications. Used by Horizon Forbidden West and Death Stranding 2.

CUDA-accelerated visual odometry and SLAM library for fast, accurate, low-latency camera tracking

Luanti (formerly Minetest) is an open source voxel game-creation platform with easy modding and game creation

Telegram Desktop messaging app

Port of OpenAI's Whisper model in C/C++

DuckDB is an analytical in-process SQL database management system

Amnezia VPN Client (Desktop+Mobile)

Speech-to-text, text-to-speech, speaker diarization, speech enhancement, source separation, and VAD using next-gen Kaldi with onnxruntime without Internet connection. Support embedded systems, Android, iOS, HarmonyOS, Raspberry Pi, RISC-V, RK NPU, Axera NPU, Ascend NPU, x86_64 servers, websocket server/client, support 12 programming languages

An MCP-based chatbot | 一个基于MCP的聊天机器人

MLX: An array framework for Apple silicon

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.