SpecFormer: Mitigating Embedding and Attention Collapse via Spectral-Aware Transformer for Recommendation

Research introduces SpecFormer, a transformer architecture mitigating embedding and attention collapse for improved recommendation systems.