Grokking on the Weight-Decay Clock: A Rate Hierarchy from Softly Broken Symmetries

New research identifies a late-time relaxation mechanism for grokking in linear models, extending to nonlinear neural networks.