TheBloke

/

guanaco-33B-GPTQ

like 75

I've set all GPTQ parameters and updated text-generation-webui to the newest version, also installed the requirements. But I get this error:

It looks like the config file at ‘models/Guanaco-33B-GPTQ-4bit.act-order.safetensors’ is not a valid JSON file.

Full stack

Traceback (most recent call last): File “/home/user/.local/lib/python3.9/site-packages/transformers/configuration_utils.py”, line 659, in _get_config_dict config_dict = cls._dict_from_json_file(resolved_config_file) File “/home/user/.local/lib/python3.9/site-packages/transformers/configuration_utils.py”, line 750, in _dict_from_json_file text = reader.read() File “/usr/lib/python3.9/codecs.py”, line 322, in decode (result, consumed) = self._buffer_decode(data, self.errors, final) UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0x89 in position 232724: invalid start byte

During handling of the above exception, another exception occurred:

Traceback (most recent call last): File “/home/user/projects/text-generation-webui/server.py”, line 71, in load_model_wrapper shared.model, shared.tokenizer = load_model(shared.model_name) File “/home/user/projects/text-generation-webui/modules/models.py”, line 77, in load_model shared.model_type = find_model_type(model_name) File “/home/user/projects/text-generation-webui/modules/models.py”, line 65, in find_model_type config = AutoConfig.from_pretrained(path_to_model, trust_remote_code=shared.args.trust_remote_code) File “/home/user/.local/lib/python3.9/site-packages/transformers/models/auto/configuration_auto.py”, line 931, in from_pretrained config_dict, unused_kwargs = PretrainedConfig.get_config_dict(pretrained_model_name_or_path, **kwargs) File “/home/user/.local/lib/python3.9/site-packages/transformers/configuration_utils.py”, line 574, in get_config_dict config_dict, kwargs = cls._get_config_dict(pretrained_model_name_or_path, **kwargs) File “/home/user/.local/lib/python3.9/site-packages/transformers/configuration_utils.py”, line 662, in _get_config_dict raise EnvironmentError( OSError: It looks like the config file at ‘models/Guanaco-33B-GPTQ-4bit.act-order.safetensors’ is not a valid JSON file.