Removing ChannelHandlerContext's when the channel is closed.