jnardiello/GLM-5.3-Flash-FP8-4-DGX-Spark-Switchless — GitHub trending stats & insights

jnardiello/GLM-5.3-Flash-FP8-4-DGX-Spark-Switchless

GLM-5.3-Flash (FP8) + DFlash2 speculative decoding on 4x NVIDIA DGX Spark / ASUS GX10: vLLM TP4, 256K context, switchless ConnectX-7 ring with patched NCCL

Visit GitHub

Shell

1 contributors

MIT License

Social mentions

Recent discussions about this repository across the web

Just pushed an update for my 4x DGX Spark - GLM 5.3 Flash (FP8) - SWITCHLESS repo. Incremental speed improvements on all metrics: prefill +10-15% decode +7-9% TTFT -20/27%. If you want upstream API…

@jnardiello · x.com

My first recipe for GLM 5.3 Flash on 4x DGX Sparks (GB10) is out: - Upstream FP8 @Zai_org GLM 5.3 Flash - Switchless direct QSFP DAC setup (no switch needed) - GB10 performance-tuned, near parity…

@jnardiello · x.com

Repository activities

repository's daily and monthly activities across stars, forks, merged PRs, issues, and closed issues