Tweak IRC fix #430 to not create multiple clients on extended reconnects