Thireus
/

WizardLM-70B-V1.0-HF-4.0bpw-h6-exl2

Text Generation

Model card Files Files and versions Community

Thireus commited on Sep 17, 2023

Commit

2be6fad

•

1 Parent(s): f8659d0

Update README.md

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -49,9 +49,9 @@ ASSISTANT:
 ## Quantization process:
-| Original Model | → | (optional but recommended) Float16 Model* | → | Safetensor Model** | → | EXL2 Model |
 | -------------- | --- | ------------- | --- | ---------------- | --- | ---------- |
-| [WizardLM 70B V1.0](https://huggingface.co/WizardLM/WizardLM-70B-V1.0) | → | [WizardLM 70B V1.0-HF](https://huggingface.co/simsim314/WizardLM-70B-V1.0-HF)* | → | Safetensor** | → | EXL2 |
 Example to convert WizardLM-70B-V1.0-HF to EXL2 4.0 bpw with 6-bit head:

 ## Quantization process:
+| Original Model | → | (optional but recommended) Float16 Model* | → | Safetensors Model** | → | EXL2 Model |
 | -------------- | --- | ------------- | --- | ---------------- | --- | ---------- |
+| [WizardLM 70B V1.0](https://huggingface.co/WizardLM/WizardLM-70B-V1.0) | → | [WizardLM 70B V1.0-HF](https://huggingface.co/simsim314/WizardLM-70B-V1.0-HF)* | → | Safetensors** | → | EXL2 |
 Example to convert WizardLM-70B-V1.0-HF to EXL2 4.0 bpw with 6-bit head: