killy-netsphere/bonsai2-1080ti
Bonsai 2 27B on a GTX 1080 Ti: Pascal (sm_61) patch for PrismML's llama.cpp fork + native MTP drafter support. 86 tok/s on code.
2
2 contributors
MIT License
Social mentions
Recent discussions about this repository across the web
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues