remove the rbm again