This model should be loaded with a customized LlamaForCausalLM, along with the adapter embeddings from llama_adapter. A instruction will be uploaded soon.
Note that this model cannot function properly with vanilla Auto Classes.
- Downloads last month
- 0
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.