Only drop ks if in preserve_cluster mode

Needed for 1.2 compatibility