iamshnoo/alpaca-cleaned-bengali
Viewer • Updated • 51.8k • 118 • 13
How to use xennonf4/Mistral-Instruct-Bangla-F16-GGUF with PEFT:
Task type is invalid.
This LoRA adapter was converted to GGUF format from Rashik24/Mistral-Instruct-Bangla via the ggml.ai's GGUF-my-lora space.
Refer to the original adapter repository for more details.
# with cli
llama-cli -m base_model.gguf --lora Mistral-Instruct-Bangla-f16.gguf (...other args)
# with server
llama-server -m base_model.gguf --lora Mistral-Instruct-Bangla-f16.gguf (...other args)
To know more about LoRA usage with llama.cpp server, refer to the llama.cpp server documentation.
16-bit
Base model
mistralai/Mistral-7B-Instruct-v0.2