These should be vectors or diagonal matrices, not dense matrices
Leaving these as always 0, as per Graves "all states and activations are initialised to zero at t = 0"
rnnlib initializes these as normal