Experimented with a culled training set.
If the high training time is an issue, a well-picked training set could dramatically reduce it, for a slight cost in accuracy. The used heuristic provides a training set that is 10-60x smaller, at a cost of ~15% in the F1 score