Update transform references when switching vessel, even when not controlling.