Only activate reconnectHandler when we have a non force-to-default listener

Untested but it compiles