kvcache-ai/ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

Data last synced with GitHub about 7 hours ago

Python

16.9k

1.3k

101 contributors

last commit about 10 hours ago

last user commit about 10 hours ago

Apache License 2.0

Repository activities

repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues

Shows when the repository has appeared on GitHub Trending across any language

python ranking