mpasila
/

Mistral-7B-Holodeck-1-exl2-4bpw

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mpasila commited on Mar 21

Commit

4d4d541

•

1 Parent(s): 6cdf3f1

Clarified quantization type

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -9,7 +9,7 @@ tags:
   - mistral
   - finetuned
 ---
-This is an EXL2 quantized model in 4bpw of [KoboldAI/Mistral-7B-Holodeck-1](https://huggingface.co/KoboldAI/Mistral-7B-Holodeck-1) using the default calibration dataset.
 # Original Model card:

   - mistral
   - finetuned
 ---
+This is an ExLlamaV2 quantized model in 4bpw of [KoboldAI/Mistral-7B-Holodeck-1](https://huggingface.co/KoboldAI/Mistral-7B-Holodeck-1) using the default calibration dataset.
 # Original Model card: