Improving mixing rate with tempered transition for learning restricted Boltzmann machines
A new training method for Restricted Boltzmann Machines (RBMs) is proposed. The new method is based on Tempered Transition which is used to sample from RBMs. Tempered Transition has strong ability for handling multimodal distributions. Tempered Transition based training method can achieve better mixing rate than the existing methods. Tempered Transition based training method can help approximate the likelihood gradient.
mixing rate tempered transition restricted boltzmann machines deep learning