ensure that we only time warp if we wish to set the clock