See the discussion in #269. We decided against that partly because neurons have no knowledge of encoders, which I need for finding the weight matrix. There are other reasons too.