Luffy503

/

UniBiomed

like 7

Hi ! Thank you for your work, and for make it accessible here, that is greatly appreciated.

I am encountering an issue when trying to load UniBiomed through the AutoModel class.
I run the code from the snippet in this repo's README (except for a fix at line 15: "return args" --> "return parser.parse_args()").

Unfortunately, I encounter the following error:

File "/home/aandurao/projects/test_unibiomed/test.py", line 22, in
AutoModel.from_pretrained(
File "/home/aandurao/projects/test_unibiomed/.venv/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 329, in from_pretrained
config, kwargs = AutoConfig.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/aandurao/projects/test_unibiomed/.venv/lib/python3.11/site-packages/transformers/models/auto/configuration_auto.py", line 1504, in from_pretrained
return config_class.from_pretrained(pretrained_model_name_or_path, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/aandurao/projects/test_unibiomed/.venv/lib/python3.11/site-packages/transformers/configuration_utils.py", line 650, in from_pretrained
return cls.from_dict(config_dict, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/aandurao/projects/test_unibiomed/.venv/lib/python3.11/site-packages/transformers/configuration_utils.py", line 844, in from_dict
logger.info(f"Model config {config}")
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/aandurao/projects/test_unibiomed/.venv/lib/python3.11/site-packages/transformers/configuration_utils.py", line 927, in repr
return f"{self.class.name} {self.to_json_string()}"
^^^^^^^^^^^^^^^^^^^^^
File "/home/aandurao/projects/test_unibiomed/.venv/lib/python3.11/site-packages/transformers/configuration_utils.py", line 1051, in to_json_string
config_dict = self.to_diff_dict()
^^^^^^^^^^^^^^^^^^^
File "/home/aandurao/projects/test_unibiomed/.venv/lib/python3.11/site-packages/transformers/configuration_utils.py", line 947, in to_diff_dict
class_config_dict = self.class().to_dict() if not self.has_no_defaults_at_init else {}
^^^^^^^^^^^^^^^^
File "/home/aandurao/.cache/huggingface/modules/transformers_modules/Luffy503/UniBiomed/5ec17d5524d8c60ee9d351595a9fddae014c2f0d/configuration_sa2va_chat.py", line 52, in init
if llm_config['architectures'][0] == 'LlamaForCausalLM':
~~~~~~~~~~^^^^^^^^^^^^^^^^^
KeyError: 'architectures'

Python version: 3.11.9
transformers: 5.5.4

Would you happen to know why this happens ?