bartowski
/

dolphin-2.6-mistral-7b-dpo-exl2

Text Generation

Model card Files Files and versions Community

bartowski commited on Jan 18

Commit

76c257d

•

1 Parent(s): d43da27

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -15,7 +15,7 @@ Original model: https://huggingface.co/cognitivecomputations/dolphin-2.6-mistral
 Model Size: 7b
 | Branch | Bits | lm_head bits | Dataset | Size | Description |
-| ----- | ---- | ------- | ------- | ------ | ------------ |
 | [8_0](https://huggingface.co/Bartowski/dolphin-2.6-mistral-7b-dpo-exl2/tree/8_0) | 8.0 | 8.0 | Default | 9.8 GB | Maximum quality that ExLlamaV2 can produce, near unquantized performance. |
 | [6_5](https://huggingface.co/Bartowski/dolphin-2.6-mistral-7b-dpo-exl2/tree/6_5) | 6.5 | 8.0 | Default | 8.6 GB | Very similar to 8.0, good tradeoff of size vs performance, **recommended**. |
 | [5_0](https://huggingface.co/Bartowski/dolphin-2.6-mistral-7b-dpo-exl2/tree/5_0) | 5.0 | 6.0 | Default | 7.4 GB | Slightly lower perplexity vs 6.5. |

 Model Size: 7b
 | Branch | Bits | lm_head bits | Dataset | Size | Description |
+| ----- | ---- | ------- | ------- | ------- | ------------ |
 | [8_0](https://huggingface.co/Bartowski/dolphin-2.6-mistral-7b-dpo-exl2/tree/8_0) | 8.0 | 8.0 | Default | 9.8 GB | Maximum quality that ExLlamaV2 can produce, near unquantized performance. |
 | [6_5](https://huggingface.co/Bartowski/dolphin-2.6-mistral-7b-dpo-exl2/tree/6_5) | 6.5 | 8.0 | Default | 8.6 GB | Very similar to 8.0, good tradeoff of size vs performance, **recommended**. |
 | [5_0](https://huggingface.co/Bartowski/dolphin-2.6-mistral-7b-dpo-exl2/tree/5_0) | 5.0 | 6.0 | Default | 7.4 GB | Slightly lower perplexity vs 6.5. |