SJTU-IPADS/PowerInfer
C++
8.2k
433
SJTU-IPADS/PowerInfer
Visit GitHub
Link copied
High-speed Large Language Model Serving for Local Deployment
all language ranking
c ranking