Error on Exlamma load in textgen

#1
by vdruts - opened

Traceback (most recent call last): File “C:\Users\xxxx\Deep\TextGen\text-generation-webui\server.py”, line 68, in load_model_wrapper shared.model, shared.tokenizer = load_model(shared.model_name, loader) File “C:\Users\xxxx\Deep\TextGen\text-generation-webui\modules\models.py”, line 79, in load_model output = load_func_maploader File “C:\Users\xxxx\Deep\TextGen\text-generation-webui\modules\models.py”, line 327, in ExLlama_HF_loader return ExllamaHF.from_pretrained(model_name) File “C:\Users\xxxx\Deep\TextGen\text-generation-webui\modules\exllama_hf.py”, line 113, in from_pretrained config.calculate_rotary_embedding_base() AttributeError: ‘ExLlamaConfig’ object has no attribute ‘calculate_rotary_embedding_base’

vdruts changed discussion status to closed

Sign up or log in to comment