Allow two users to control same object smoothly

fixes #2462