Add a setting to configure rejoin on reconnect behaviour