decoderesearch/circuit-tracer

A library for mechanistic interpretability of GPT-style language models

Companion code for the global workspace interpretability paper

Training Sparse Autoencoders on Language Models

Model interpretability and understanding for PyTorch

Transformer Explained Visually: Learn How LLM Transformer Models Work with Interactive Visualization

A JAX research toolkit for building, editing, and visualizing neural networks.

Class activation maps for your PyTorch models (CAM, Grad-CAM, Grad-CAM++, Smooth Grad-CAM++, Score-CAM, SS-CAM, IS-CAM, XGrad-CAM, Layer-CAM, Finer-CAM, LeGrad, RefineCAM)

Stanford NLP Python library for Representation Finetuning (ReFT)