Only notify about disconnection if connected.