Before revision:  We show that, when a classification network istrained with the cross-entropy loss, its final classi-fication layer forms aGenerative-Discriminativepairwith a generative classifier based on a specificdistribution of penultimate activations.
After revision:  We show that, when a classification network istrained with the cross-entropy loss, its final classification layer forms a Generative-Discriminative pair with a generative classifier based on a specificdistribution of penultimate activations.