Remove HPACK reference set