Missing config.json file for medalpaca-lora-7b8bit model
#1
by
alerio
- opened
Hi,
I tried to download the model via huggingface, but receiving the following error:
OSError: medalpaca/medalpaca-lora-7b-8bit does not appear to have a file named config.json. Checkout 'https://huggingface.co/medalpaca/medalpaca-lora-7b-8bit/main' for available files.
Is it possible to upload this file?
Best
Hey, this problem occurs if you try to load the model without the LLaMA weights. LoRA is just an adapter and thus comes without the main config, you will still need to load the base model.
you can clone the model then edit the files in colab ... and because this lora only targeted these gates ... it maybe universal for mistral and llama ?so you can change the base model in adapter config to match your own model !