Explicitly clean up connection

Ensure the channel and the swift connection are always closed when
the transport thread is not live anymore.
At this point we support up to swifclient 1.9.0