Submit repository
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
NVIDIA/Megatron-LM — GitHub trending stats & insights | Trendshift
Featured
Bindu
Openhuman
Embed Badge
Visit GitHub
NVIDIA/Megatron-LM
#
NLP
#
AI infrastructure
Ongoing research training transformer models at scale
Python
16.6k
4k
342 contributors
Custom license
website
Social mentions
Recent discussions about this repository across the web
so qwen3 vl used megatron-lm ( for pretraining (see sec 4.6 2nd par Im considering refactoring my training pipeline to use this one. anyone have ever used it? looking at some repos ( seems like…
@gkswhddnjc · x.com
Top 25 terms every AI Engineer must know right now: Core Architecture & Systems 1. Foundational Tech: Transformers: 2. Next-Gen Architecture: State Space Models (SSMs): 3. MoE Routing: Mixture of…
@Alacritic_Super · x.com
NVIDIA just released Nemotron CLIMB Proxy Models on Hugging Face Small decoder-only models (62M & 350M params) trained on 10T tokens for scaling law research, enabling prediction of larger model…
@HuggingPapers · x.com
🐾 Megatron-LM: GPU-optimized transformer model training library Dive into cutting-edge AI research with GPU-accelerated models and advanced parallelism strategies! Learn more: Follow @repocatai_git…
@repocatai_git · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues
GitHub trending history
Shows when the repository has appeared on GitHub Trending across any language
all language ranking
python ranking
