Submit repository
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
0xSojalSec/airllm — GitHub trending stats & insights | Trendshift
Sponsor spot open
·
promote your product
0xSojalSec/airllm
#
Local LLM
Runs 405B LLMs on 8GB VRAM
Visit GitHub
Jupyter Notebook
3k
229
Apache License 2.0
Social mentions
Recent discussions about this repository across the web
哇靠！4GB显存就能带动70B参数大模型，属实离谱！ AirLLM靠着分层推理的新思路，不再一次性载入完整模型，分层加载计算，用完随即释放显存，小显卡也能驾驭巨型模型。 项目全程开源免费，想要尝试的别错过。 🔗
@LuBtc888 · x.com
4GB显存跑70B大模型？这事儿真成了！ AirLLM玩了个骚操作——分层推理，不一次性把模型怼进显存，而是一层层加载、算完就扔，硬生生把巨无霸塞进小破卡。 最骚的是：100%开源，白嫖警告⚠️ 🔗
@NFTCPS · x.com
No trending activity
This repository has not yet been featured on GitHub Trending
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues