bouthilx: Would updating that part of the code change the generated numbers?

bartvm, dwf: I fail to see the advantage of it. The only time we create theano_rng is at the top MLP when we call its dropout_fprop. We have to pass it to sublayers, which don't have access to mlp.theano_rng. But did you meant that when we set_mlp, we would get a reference to mlp.theano_rng, so we don't have to pass it?