SILO: Characterizing structure in deep classifiers through Neural Collapse
Abstract: In this talk I will describe recent progress in characterizing structure that emerges during the training of deep neural networks for classification. Neural Collapse is a phenomenon that emerges during the training of deep classifiers in which the top-layer feature embeddings of samples from the same class tend to …