WizardLM-13B-V1.0-Uncensored-GGML

Runtime error

ffreemt commited on Jul 6, 2023

Commit

e178694

•

1 Parent(s): c81b306

Update model_type="llama"

Files changed (1) hide show

app.py CHANGED Viewed

@@ -234,7 +234,7 @@ LLM = AutoModelForCausalLM.from_pretrained(
     # "TheBloke/WizardCoder-15B-1.0-GGML",
     REPO_ID,  # DESTINATION_FOLDER,  # model_path_or_repo_id: str required
     model_file=_,
-    # model_type=None,   # "starcoder",  AutoConfig.from_pretrained("TheBloke/WizardLM-13B-V1.0-Uncensored-GGML")
     threads=os.cpu_count() // 2,  # type: ignore
 )

     # "TheBloke/WizardCoder-15B-1.0-GGML",
     REPO_ID,  # DESTINATION_FOLDER,  # model_path_or_repo_id: str required
     model_file=_,
+    model_type="llama",   # "starcoder",  AutoConfig.from_pretrained("TheBloke/WizardLM-13B-V1.0-Uncensored-GGML")
     threads=os.cpu_count() // 2,  # type: ignore
 )