Lewdiculous
/

Nina-v2-7B-GGUF-IQ-Imatrix

Inference Endpoints

Model card Files Files and versions Community

Lewdiculous commited on Mar 16

Commit

107d1d8

•

1 Parent(s): 3c28b57

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -4,10 +4,11 @@ tags:
 - gguf
 - mistral
 - roleplay
 ---
 This repository hosts GGUF-IQ-Imatrix quants for [Virt-io/Nina-v2-7B](https://huggingface.co/Virt-io/Nina-v2-7B).
-Quantizing and uploading:
 ```python
     quantization_options = [
         "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",

 - gguf
 - mistral
 - roleplay
+- sillytavern
 ---
 This repository hosts GGUF-IQ-Imatrix quants for [Virt-io/Nina-v2-7B](https://huggingface.co/Virt-io/Nina-v2-7B).
+Quants:
 ```python
     quantization_options = [
         "Q4_K_M", "Q4_K_S", "IQ4_XS", "Q5_K_M", "Q5_K_S",