Working on world model or SSL? You definitely need to try our new work: VISReg! What does it achieve? 💪 Strong collapse prevention: High gradient when embedding collapse ⚡ Friendly to scale…

VISReg: Variance-Invariance-Sketching Regularization for JEPA training "We propose VISReg (Variance-Invariance-Sketching Regularization), a novel method that prevents embeddings from collapse while…