Submit repository
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
sgl-project/sglang — GitHub trending stats & insights | Trendshift
Sponsor spot open
·
promote your product
Embed Badge
Visit GitHub
sgl-project/sglang
#
AI infrastructure
SGLang is a high-performance serving framework for large language models and multimodal models.
Python
29.2k
6.4k
1,542 contributors
Apache License 2.0
website
Social mentions
Recent discussions about this repository across the web
记: 第三周,今天跑起了多机RL,在给miles/sglang加distributed lora training的feature,这张卡当train engine, 另一边2X5060Ti当rollout engine,家用交换机互联,已经跑起来了,十分开心 pr:
@Orange41324306 · x.com
🤖 sglang ⭐ 28,406 stars Stop wasting GPU cycles. Serve LLMs and multimodal models at warp speed with a high-performance serving engine built for maximum throughput. 🔗 #AI #MachineLearning
@Marco_Ramilli · x.com
This change to SGLang allows peers to recover after returning too many errors by probing them with Mooncake send_probe. The permanent denylist was causing a low volume of errors because the pods…
@kevin_flansburg · x.com
Landed changes to SGLang to address two use-after-free bugs in decode side KV cache. This was causing garbled output with Kimi K2.6 under heavy concurrency when using decode KV cache offload.
@kevin_flansburg · x.com
componentになっているかは少し古い場合はその様なコメント(
@neko_sub1_nos · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues
GitHub trending history
Shows when the repository has appeared on GitHub Trending across any language
all language ranking
python ranking