[SPARK-3106] Fix the race condition issue about Connection and ConnectionManager

A compromised solution may be remove the logging but, the situations thrown CancelledKeyException, ClosedChannelException, AsyncronousCloseException even if resolve race condition are fatal. I think we should leave logging logic for detect such fatal situation.
I want error message to appear when we actually need.