sophosympatheia
/

Midnight-Rose-103B-v2.0.3

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

sophosympatheia commited on Feb 17

Commit

93be35c

•

1 Parent(s): 730c489

Update README.md

Added links to exl2 quants

Files changed (1) hide show

README.md +5 -0

README.md CHANGED Viewed

@@ -138,6 +138,11 @@ If you save this as a .json file, you can import it directly into Silly Tavern.
 ### Quantizations
 * Static GGUF -- [mradermacher/Midnight-Rose-103B-v2.0.3-GGUF](https://huggingface.co/mradermacher/Midnight-Rose-103B-v2.0.3-GGUF)
 * Weighted GGUF -- [mradermacher/Midnight-Rose-103B-v2.0.3-i1-GGUF](https://huggingface.co/mradermacher/Midnight-Rose-103B-v2.0.3-i1-GGUF)
 ### Licence and usage restrictions

 ### Quantizations
 * Static GGUF -- [mradermacher/Midnight-Rose-103B-v2.0.3-GGUF](https://huggingface.co/mradermacher/Midnight-Rose-103B-v2.0.3-GGUF)
 * Weighted GGUF -- [mradermacher/Midnight-Rose-103B-v2.0.3-i1-GGUF](https://huggingface.co/mradermacher/Midnight-Rose-103B-v2.0.3-i1-GGUF)
+* Exl2 2.4bpw -- [llmixer/Midnight-Rose-103B-v2.0.3-2.4bpw-h6-exl2](https://huggingface.co/llmixer/Midnight-Rose-103B-v2.0.3-2.4bpw-h6-exl2)
+* Exl2 3.0bpw -- [llmixer/Midnight-Rose-103B-v2.0.3-3.0bpw-h6-exl2](https://huggingface.co/llmixer/Midnight-Rose-103B-v2.0.3-3.0bpw-h6-exl2)
+* Exl2 3.5bpw -- [llmixer/Midnight-Rose-103B-v2.0.3-3.5bpw-h6-exl2](https://huggingface.co/llmixer/Midnight-Rose-103B-v2.0.3-3.5bpw-h6-exl2)
+* Exl2 4.0bpw -- [llmixer/Midnight-Rose-103B-v2.0.3-4.0bpw-h6-exl2](https://huggingface.co/llmixer/Midnight-Rose-103B-v2.0.3-4.0bpw-h6-exl2)
+* Exl2 5.0bpw -- [llmixer/Midnight-Rose-103B-v2.0.3-5.0bpw-h6-exl2](https://huggingface.co/llmixer/Midnight-Rose-103B-v2.0.3-5.0bpw-h6-exl2)
 ### Licence and usage restrictions