Doesn't this create a rather huge model? Maybe a `LinearSVC(penalty="l1")` is more appropriate as the first step, since it's much more compact.

(This is an artifact of our implementation, but let's keep quiet about that...)