Only shift objects in Z if min z is below zero.  If Z is above zero, let's assume that's on purpose.