QuantFactory/Hathor_Stable-v0.2-L3-8B-GGUF

This is quantized version of Nitral-AI/Hathor_Stable-v0.2-L3-8B created using llama.cpp

Model Description

image/jpeg

"Hathor-v0.2 is a model based on the LLaMA 3 architecture: Designed to seamlessly integrate the qualities of creativity, intelligence, and robust performance. Making it an ideal tool for a wide range of applications; such as creative writing, educational support and human/computer interaction."

Recomended ST Presets: Hathor Presets


Notes: Hathor is trained on 3 epochs of private data, synthetic opus instructons, a mix of light/classical novel data, roleplaying chat pairs over llama 3 8B instruct. (expanded)

Downloads last month
224
GGUF
Model size
8.03B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Examples
Unable to determine this model's library. Check the docs .

Model tree for QuantFactory/Hathor_Stable-v0.2-L3-8B-GGUF

Quantized
(11)
this model