Don't send goaway when network connection is closed.
Remove unnecessary copies of channels.

No reason to keep them around.