Always train the lower layers of the network.