RahulSChand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
Achievements
Trendshift snapshots GitHub's daily Trending list and runs its own trending list. The dynamic badges below mark the best position this repository has reached on each platform. They refresh automatically as its position climbs
GitHub Trending
RahulSChand/gpu_poor has been featured on GitHub Trending, first reaching #10 on Oct 27, 2023
Trendshift Trending
RahulSChand/gpu_poor has trended on Trendshift's daily and weekly list
Daily
First achieved on 5th, Oct 2024 for JavaScript
First achieved on 6th, Oct 2024 across all languages