Signal
Advertise
Signal
Advertise
Sign in
Submit
Discover trends that matter
Trending repositories
Daily
Weekly
Monthly
Yearly
Live mentions
Topics
GitHub trending
Repositories
Developers
Insights
Stats
Log in
SpaceshipCreative/vllm-3090-fixes — GitHub trending stats & insights | Trendshift
Featured
open-connector
SpaceshipCreative/vllm-3090-fixes
#
AI infrastructure
Patches enabling NVLink symmetric-memory all-reduce and related fast paths on Ampere (sm_80/sm_86) for vLLM and FlashInfer
Visit GitHub
Python
2 contributors
MIT License
Social mentions
Recent discussions about this repository across the web
It mostly shows up in decode but if you run DP=2 plus expert parallel on smaller models you can get a nice pre-fill boost too but it's smaller than the decode boost, about 1.3x.
@Authentic1ty · x.com
Repository activities
repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues