Don't lock when updating the learning rate. It should be atomic.