Tried early stopping, without much success - the loss of the validation samples really hurts.