Do not allocate input matrix for each mini-batch.