cgus
/

Qwen2-7B-Instruct-abliterated-iMat-GGUF

Text Generation

Model card Files Files and versions Community

cgus commited on Oct 5

Commit

6810799

•

1 Parent(s): 673c520

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -17,7 +17,7 @@ Created by: [Qwen](https://huggingface.co/Qwen)
 ## Quantization notes
 Made with llama.cpp-b3154 with imatrix file based on Exllamav2 calibration file.
-05.10.2024 Added quants for phones Q4_0_4_4 (budget ARM devices), Q4_0_4_8, Q4_0_8_8 (high end devices).
 # Original model card
 # Qwen2-7B-Instruct-abliterated

 ## Quantization notes
 Made with llama.cpp-b3154 with imatrix file based on Exllamav2 calibration file.
+05.10.2024 Added quants for ARM devices Q4_0_4_4 (low end), Q4_0_4_8, Q4_0_8_8 (high end).
 # Original model card
 # Qwen2-7B-Instruct-abliterated