Added asserts to make sure ChannelHandlers are removed from the pipeline