I think this depends on the number of non-zeros. I would rather say that "Training time can be orders of magnitude faster" for a sparse matrix input compare to a dense matrix when features have zero values in most of the samples.