From a testing time perspective, it would be better to use a dataset with sparse input. This [generator](http://scikit-learn.org/stable/modules/generated/sklearn.datasets.make_classification.html#sklearn.datasets.make_classification) gives sparse input (even if it's a numpy array).