rryam/VecturaKit

Swift package for on-device Retrieval-Augmented Generation (RAG)

Shared Single-file memory layer for all your agents, sub mili-second RAG over text, photo and video on Apple Silicon.. No Server. No API. One File. Pure Swift

LLM.swift is a simple and readable library that allows you to interact with large language models locally with ease for macOS, iOS, watchOS, tvOS, and visionOS.

Run LLMs on Apple devices with CoreML, optimized for Apple Neural Engine + GPU

TalaDB - An open-source embedded vector and document database for building local-first AI applications.

A lightweight, lightning-fast, in-process vector database

🚀 LLM inference Engine in Swift/Metal, Load GGUF and safe tensors modes, no conversion, no cpp, pure swift

Swift SDK for running chat, vision and speech models on iPhone and Mac with Apple's Core AI. Model download and caching, FoundationModels integration, and runnable examples with documented OS, SDK and model requirements.

Run embedding models locally in Swift using MLTensor.