IBM/vLLM-Hook

A library for mechanistic interpretability of GPT-style language models

The nnsight package enables interpreting and manipulating the internals of deep learned models.

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/llm-transparency-tool-demo

Based on Nano-vLLM, a simple replication of vLLM with self-contained paged attention and flash attention implementation

Interactive Composition Explorer: a debugger for compositional language model programs

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

Official inference library for Mistral models

AI Observability & Evaluation