Steelskull
commited on
Commit
•
e916002
1
Parent(s):
806816a
Update README.md
Browse files
README.md
CHANGED
@@ -124,9 +124,10 @@ MS = Model Stock
|
|
124 |
</code></pre>
|
125 |
<p>This model is a remake of the original astoria with modern models and context sizes its goal is to merge the robust storytelling of mutiple models while attempting to maintain intelligence.</p>
|
126 |
<p>Use Llama 3 Format or meth format (llama 3 refuses to work with stepped thinking but meth works)</p>
|
127 |
-
<h2>Quants
|
128 |
-
<p>GGUF Quant:
|
129 |
-
<p>
|
|
|
130 |
<h3>Config:</h3>
|
131 |
<pre><code>MODEL_NAME = "L3.1-MS-Astoria-70b-v2"
|
132 |
base_model: mlabonne/Llama-3.1-70B-Instruct-lorablated
|
|
|
124 |
</code></pre>
|
125 |
<p>This model is a remake of the original astoria with modern models and context sizes its goal is to merge the robust storytelling of mutiple models while attempting to maintain intelligence.</p>
|
126 |
<p>Use Llama 3 Format or meth format (llama 3 refuses to work with stepped thinking but meth works)</p>
|
127 |
+
<h2>Quants: (List of badasses)</h2>
|
128 |
+
<p>GGUF Quant: </p>
|
129 |
+
<p> - bartowski: <a href="https://huggingface.co/bartowski/L3.1-MS-Astoria-70b-v2-GGUF" target="_blank"> Combined-GGUF </a></p>
|
130 |
+
<p> - mradermacher: <a href="https://huggingface.co/mradermacher/L3.1-MS-Astoria-70b-v2-GGUF" target="_blank"> GGUF </a>// <a href="https://huggingface.co/mradermacher/L3.1-MS-Astoria-70b-v2-i1-GGUF" target="_blank"> Imat-GGUF </a></p>
|
131 |
<h3>Config:</h3>
|
132 |
<pre><code>MODEL_NAME = "L3.1-MS-Astoria-70b-v2"
|
133 |
base_model: mlabonne/Llama-3.1-70B-Instruct-lorablated
|