Panchovix
/

llama-2-70b-Guanaco-QLoRA-fp16-safetensors

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

llama-2-70b-Guanaco-QLoRA-fp16-safetensors / README.md

Panchovix's picture

Update README.md

8b7a45a about 1 year ago

|

229 Bytes

	---
	license: llama2
	---
	Safetensors conversion of llama-2-70b-Guanaco-QLoRA-fp16 (https://huggingface.co/TheBloke/llama-2-70b-Guanaco-QLoRA-fp16/tree/main), to be used directly on transformers, or to create quants with exllamav2.