You could do that, but it seems inconsistent to me to return `VectorSpace` data for the `fprop` method when a layer's output space is set to `IndexSpace`, no?

For a minibatch size of 256 and a softmax with 30,000 outputs you would save around 30MB of memory.