A local learning algorithm for dynamic feedforward and recurrent networks . One advantage of truly local algorithms is that their parallel implementation is trivial. The Neural Heat Exchanger First consider a conventional, physical heat exchanger. There are two touching water pipes with opposite flow direction. Cold water enters the first pipe.
Hot water enters the second pipe.
J. H. Schmidhuber. A local learning algorithm for dynamic feedforward and recurrent networks . If a system is in a state which it assumes to be a bad state, but there is a transition which leads to a state assumed to be a good state, then this transition should be encouraged. The critic may be linear, because the final mapping to be implemented by the critic in general is simpler than the final mapping to be implemented by the main network. 4 Two Interacting Fully Recurrent Self Supervised Learning Networks for Reinforcement Learning Abstract.