Question: What novel class of recurrent-like networks is proposed?
Answer: A network, whose learned functions satisfy a certain equation. The  network contains RNN cells with either nested internal memories or dependencies that extend temporally beyond the immediately previous hidden state.