openxla/xla

Open Machine Learning Compiler Framework

A retargetable MLIR-based machine learning compiler and runtime toolkit.

You like pytorch? You like micrograd? You love tinygrad! ❤️

Any model. Any hardware. Zero compromise. Built with @ziglang / @openxla / MLIR / @bazelbuild

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Development repository for the Triton language and compiler

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools