Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment
Data last synced with GitHub 1 day ago
C++
8.8k
501
14 contributors
last commit about 2 months ago
last user commit about 2 months ago
MIT License
created over 2 years ago
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues
Recent daily activities
Monthly activities
GitHub trending history
Shows when the repository has appeared on GitHub Trending across any language
all language ranking
c++ ranking
c ranking