[SPARK-3106] Fix the race condition issue about Connection and ConnectionManager

If remote host shut down suddenly by accidents, connection should be closed. I think, it's not normal.

Hmm, I think ignoring / hiding or declining severity of those ugly message are one of compromised solutions.