mosecorg/mosec

An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

A flexible, high-performance serving system for machine learning models

A flexible, high-performance carrier for machine learning models（『飞桨』服务化部署框架）

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

The simplest way to serve AI/ML models in production

Serve, optimize and scale PyTorch models in production

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models