SJTU-IPADS/PowerInfer
High-speed Large Language Model Serving for Local Deployment
Data last synced with GitHub about 24 hours ago
C++
8.6k
477
14 contributors
last commit 1 day ago
last user commit 1 day ago
MIT License
created about 2 years ago
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues
Recent daily activities
Monthly activities
GitHub trending history
Shows when the repository has appeared on GitHub Trending across any language
all language ranking
c++ ranking
c ranking