gravity: Fix connect on destruct if we didn't connect before.