KellerJordan/Muon

Dion optimizer algorithm

For optimization algorithm research and development.

Fast & Simple Resource-Constrained Learning of Deep Network Structure

Schedule-Free Optimization in PyTorch

Optax is a gradient processing and optimization library for JAX.

PyTorch native quantization for training and inference

Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.

Riemannian Adaptive Optimization Methods with pytorch optim

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.