Submit repository
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
FareedKhan-dev/train-llm-from-scratch — GitHub trending stats & insights | Trendshift
Featured
Bindu
Openhuman
FareedKhan-dev/train-llm-from-scratch
#
NLP
A straightforward method for training your LLM, from downloading data to generating text.
Visit GitHub
Jupyter Notebook
1.9k
328
6 contributors
MIT License
website
Social mentions
Recent discussions about this repository across the web
If you want to train LLM from scratch try this repo. Link -> #ai #LLM #nlp #ML #machinelearning
@mharshald · x.com
this repo trains billion-param llms from scratch on a single gpu most ppl still think you need a datacenter + $10m to do this it’s the full gpt scaffold, tokenizer to distributed tricks, all oss
@KayvonJafar · x.com
What I'd test first: the 2B model reportedly produced worse output than the 13M at long sequences. That cuts against "bigger is better" — but it's one repo's observation, not an ablation. I'd want to…
@SturlaLang · x.com
13M parameters on a free Colab GPU. That's the floor where text starts looking like real English, according to this "train an LLM from scratch" repo trending today.
@SturlaLang · x.com
[7/8] 💻 GitHub Trending Tool converts code into interactive knowledge graphs for exploration and querying across multiple AI coding assistants.
@ProbBrain · x.com
2 GitHub repos worth bookmarking this week 🧵 1/ codeburn - track exactly where your AI coding tokens and costs go. • Works with Claude Code, Codex, Cursor, Copilot • Detects wasted tokens…
@Giri_dharan__ · x.com
2 GitHub repos worth bookmarking this week 🧵 1/ codeburn - track exactly where your AI coding tokens and costs go. • Works with Claude Code, Codex, Cursor, Copilot • Detects wasted tokens…
@akhil_r777 · x.com
Trains billion-parameter LLMs from scratch on a single GPU
@tom_doerr · x.com
LEARN MACHINE LEARNING(AI) IN A VISUALIZED WAY
@KFCypher · x.com
No trending activity
This repository has not yet been featured on GitHub Trending
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues