list of awesome platforms, tools, and resources run for LLMs locally
Like 0xSojalSec/LLMs-local, 0 likes 0 Bookmark 0xSojalSec/LLMs-local, 0 bookmarks 0 A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally
Like rafska/awesome-local-llm, 0 likes 0 Bookmark rafska/awesome-local-llm, 0 bookmarks 0 Run a 1-billion parameter LLM on a $10 board with 256MB RAM
Like RightNow-AI/picolm, 0 likes 0 Bookmark RightNow-AI/picolm, 0 bookmarks 0 Smart inference engine that adapts to your hardware to run models faster, even when they don’t fit in memory
Like jitllm/jitllm, 0 likes 0 Bookmark jitllm/jitllm, 0 bookmarks 0 Running a LLM on the ESP32
Like DaveBben/esp32-llm, 0 likes 0 Bookmark DaveBben/esp32-llm, 0 bookmarks 0 High-speed Large Language Model Serving for Local Deployment
Like Tiiny-AI/PowerInfer, 0 likes 0 Bookmark Tiiny-AI/PowerInfer, 0 bookmarks 0 On-device LLM Inference Powered by X-Bit Quantization
Like Picovoice/picollm, 0 likes 0 Bookmark Picovoice/picollm, 0 bookmarks 0 Which local LLMs can your computer run? Hardware-aware CLI, TUI and GUI: yes/slow/no verdicts and tok/s from your GPU VRAM and RAM, then verified installs via Ollama, llama.cpp, MLX and LM Studio. Native Rust.
Like shashankswe2020-ux/rigspark, 0 likes 0 Bookmark shashankswe2020-ux/rigspark, 0 bookmarks 0