Fixed bug when mixing conv and normal layers.