vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Data last synced with GitHub 1 day ago
Python
74.2k
14.7k
2,249 contributors
last commit 1 day ago
last user commit 1 day ago
Apache License 2.0
created about 3 years ago
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues
GitHub trending history
Shows when the repository has appeared on GitHub Trending across any language
all language ranking
python ranking