@ogrisel I just made the error rate to 0.017 :) 
(fixed an issue with `tanh` derivative - it didn't pass the gradient test until now)

@jnothman indeed, better to make RBM pipelining a separate PR