windog-labs/edge-fm-x

High-performance, light-weight C++ LLM and VLM Inference Software for Physical AI

[CoRL'26 Spotlight] Inference engine of "EagleVLA: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inference". Formerly known as Jetson-PI-Edge.

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Quantization, kernels, runtime and inference engine for mobiles, wearables, smart home and robots.

Unified, efficient, and easy-to-use inference infrastructure for edge AI || 面向端侧 AI 的统一、高效、易用的推理基础设施

FlashRT is a high-performance realtime inference engine for small-batch, latency-sensitive AI workloads. The flagship integration is production VLA control for Pi0, Pi0.5, GROOT N1.6, and Pi0-FAST. Also support llm e.g, qwen3.6-27B

QVAC Fabric: cross-platform LLM inference and fine-tuning, optimized for edge devices and heterogenous GPUs