I don't think we want to do this. Like I said before, we should think of layers as belonging only to their immediate parent. The main thing self.mlp is used for is to get the parent's rng and batch size.

I think the correct handling of the RNG is probably a bit complicated, just come talk to me when you want to work on that.