How to use ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF", device_map="auto")
How to use ggml-org/LoRA-Qwen2.5-3B-Instruct-abliterated-F16-GGUF with PEFT:
Task type is invalid.
