Allow training with extra unsupervised data for bottleneck layers