microsoft/mscclpp

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

Optimized primitives for collective multi-GPU communication

Distributed Compiler and Optimized Parallel Kernels

A fast communication-overlapping library for tensor/expert parallelism on GPUs.

NVIDIA NVSHMEM is a parallel programming interface for NVIDIA GPUs based on OpenSHMEM. NVSHMEM can significantly reduce multi-process communication and coordination overheads by allowing programmers to perform one-sided communication from within CUDA kernels and on CUDA streams.

DeepEP: an efficient expert-parallel communication library

NVIDIA Inference Xfer Library (NIXL)

cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.

PyTorch Single Controller