Fix many, many bugs regarding swapping classifiers.