SJTU-IPADS/PowerInfer
C++
8.2k
426
SJTU-IPADS/PowerInfer
Visit GitHub
Link copied
High-speed Large Language Model Serving for Local Deployment
all language ranking
c ranking