lee-ite/Llama-3.1-8B-PHQ

This LoRA was converted to GGUF format from lee-ite/Llama-3.1-8B-PHQ-lora using llama.cpp. The base Model is meta-llama/Meta-Llama-3.1-8B-Instruct.

Use with llama.cpp

You need to merge the LoRA-GGUF into the Base-Model use llama.cpp.