MohammadHaishemKhawaja/hashyy
A full, unpruned 177B MoE model at 11.5 tok/s on one 12 GB GPU. Expert streaming for llama.cpp, with the measurement harness and every dead end.
Python
9
3
2 contributors
Custom license
Social mentions
Recent discussions about this repository across the web
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues