vllm-project/aibrix

vllm-project/aibrix

Cost-efficient and pluggable Infrastructure components for GenAI inference

Data last synced with GitHub about 8 hours ago

4.7k

544

115 contributors

last commit about 21 hours ago

last user commit about 21 hours ago

Apache License 2.0

created almost 2 years ago

Repository activities

repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues

Shows when the repository has appeared on GitHub Trending across any language

all language ranking

go ranking