Prisma-Multimodal/ViT-Prisma

Class activation maps for your PyTorch models (CAM, Grad-CAM, Grad-CAM++, Smooth Grad-CAM++, Score-CAM, SS-CAM, IS-CAM, XGrad-CAM, Layer-CAM, Finer-CAM, LeGrad, RefineCAM)

Official repository for "VideoPrism: A Foundational Visual Encoder for Video Understanding" (ICML 2024)

Advanced AI Explainability for computer vision. Support for CNNs, Vision Transformers, Classification, Object detection, Segmentation, Image similarity and more.

A deep learning library for video understanding research.

Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.

Implementation of Vision Mamba from the paper: "Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model" It's 2.8x faster than DeiT and saves 86.8% GPU memory when performing batch inference to extract features on high-res images

OpenMMLab Pre-training Toolbox and Benchmark

Scenic: A Jax Library for Computer Vision Research and Beyond

LAVIS - A One-stop Library for Language-Vision Intelligence