Revert remove_small_objects to raise TypeError
Merge pull request #460 from jni/raise-type

BUG: Revert `remove_small_objects` to raise TypeError.