bullerwins
/

Hermes-2-Theta-Llama-3-70B-exl2_4.0bpw

Text Generation

function calling

structured outputs

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

bullerwins commited on Jun 21

Commit

2a7b078

•

1 Parent(s): 483792f

Update README.md

Files changed (1) hide show

README.md +3 -0

README.md CHANGED Viewed

@@ -10,6 +10,9 @@ tags:
 - structured outputs
 - json mode
 ---
 # Hermes 2 Theta Llama-3 70B Model Card

 - structured outputs
 - json mode
 ---
+Quantized to exl2 using [Exllamav2 0.1.5](https://github.com/turboderp/exllamav2)
+Original model [NousResearch/Hermes-2-Theta-Llama-3-70B](https://huggingface.co/NousResearch/Hermes-2-Theta-Llama-3-70B)
 # Hermes 2 Theta Llama-3 70B Model Card