gptq-4bit-32g-actorder_True
model = AutoGPTQForCausalLM.from_quantized(model_name_or_path,
revision="gptq-4bit-32g-actorder_True",
model_basename=model_basename,
use_safetensors=True,
trust_remote_code=True,
device="cuda:0",
use_triton=use_triton,
quantize_config=None)
HTTPError: 404 Client Error: Not Found for url: https://huggingface.co/usamakenway/llama2_7b_chat_uncensored-AutoGPTQ_Wizard_Vicuna/resolve/gptq-4bit-32g-actorder_True/config.json
The above exception was the direct cause of the following exception:
RevisionNotFoundError Traceback (most recent call last)
RevisionNotFoundError: 404 Client Error. (Request ID: Root=1-651d9107-2802000a2058499d55057e55;5e1c90fc-1e58-48ce-a0da-3b76bb89c1ff)
Revision Not Found for url: https://huggingface.co/usamakenway/llama2_7b_chat_uncensored-AutoGPTQ_Wizard_Vicuna/resolve/gptq-4bit-32g-actorder_True/config.json.
Invalid rev id: gptq-4bit-32g-actorder_True
The above exception was the direct cause of the following exception:
OSError Traceback (most recent call last)
/usr/local/lib/python3.10/dist-packages/transformers/utils/hub.py in cached_file(path_or_repo_id, filename, cache_dir, force_download, resume_download, proxies, token, revision, local_files_only, subfolder, repo_type, user_agent, _raise_exceptions_for_missing_entries, _raise_exceptions_for_connection_errors, _commit_hash, **deprecated_kwargs)
455 ) from e
456 except RevisionNotFoundError as e:
--> 457 raise EnvironmentError(
458 f"{revision} is not a valid git identifier (branch name, tag name or commit id) that exists "
459 "for this model name. Check the model page at "
OSError: gptq-4bit-32g-actorder_True is not a valid git identifier (branch name, tag name or commit id) that exists for this model name. Check the model page at 'https://huggingface.co/usamakenway/llama2_7b_chat_uncensored-AutoGPTQ_Wizard_Vicuna' for available revisions.