Backpropagation requires clean up