fix NPE for defer_client_bind_addr=true