Ensure that we close the channel even if the with_channel block thrown an exception