we only store the min_pat inds rather than all the svms