Self-Distillation of Hidden Layers for Self-Supervised Representation Learning

Research introduces 'self-distillation of hidden layers' for self-supervised learning, aiming for efficient, stable high-level embedding generation.