IHaveNoClueAndIMustPost
commited on
Commit
•
fb5ae76
1
Parent(s):
ce3ef46
Update README.md
Browse files
README.md
CHANGED
@@ -10,7 +10,7 @@ This is [Llama2-22b](https://huggingface.co/chargoddard/llama2-22b) in a couple
|
|
10 |
While I haven't had any issues so far do note that the original repo states <i>"Not intended for use as-is - this model is meant to serve as a base for further tuning"</b>.
|
11 |
|
12 |
Approximate VRAM requirements at 4K context:
|
13 |
-
<table style='border: 2px #000000 solid; width:
|
14 |
<tbody>
|
15 |
<tr>
|
16 |
<td style='text-align: center'>MODEL</td>
|
@@ -19,22 +19,22 @@ Approximate VRAM requirements at 4K context:
|
|
19 |
</tr>
|
20 |
<tr>
|
21 |
<td style='text-align: center'>q5_1</td>
|
22 |
-
<td style='text-align: center'>
|
23 |
<td style='text-align: center'>21.5GB</td>
|
24 |
</tr>
|
25 |
<tr>
|
26 |
<td style='text-align: center'>q4_K_M</td>
|
27 |
-
<td style='text-align: center'>
|
28 |
<td style='text-align: center'>18.3GB</td>
|
29 |
</tr>
|
30 |
<tr>
|
31 |
<td style='text-align: center'>q3_K_M</td>
|
32 |
-
<td style='text-align: center'>10.
|
33 |
<td style='text-align: center'>16.1GB</td>
|
34 |
</tr>
|
35 |
<tr>
|
36 |
<td style='text-align: center'>q2_K</td>
|
37 |
-
<td style='text-align: center'>9.
|
38 |
<td style='text-align: center'>14.5GB</td>
|
39 |
</tr>
|
40 |
</tbody>
|
|
|
10 |
While I haven't had any issues so far do note that the original repo states <i>"Not intended for use as-is - this model is meant to serve as a base for further tuning"</b>.
|
11 |
|
12 |
Approximate VRAM requirements at 4K context:
|
13 |
+
<table style='border: 2px #000000 solid; width: 20%' align='left' border='2'>
|
14 |
<tbody>
|
15 |
<tr>
|
16 |
<td style='text-align: center'>MODEL</td>
|
|
|
19 |
</tr>
|
20 |
<tr>
|
21 |
<td style='text-align: center'>q5_1</td>
|
22 |
+
<td style='text-align: center'>16.4GB</td>
|
23 |
<td style='text-align: center'>21.5GB</td>
|
24 |
</tr>
|
25 |
<tr>
|
26 |
<td style='text-align: center'>q4_K_M</td>
|
27 |
+
<td style='text-align: center'>13.2GB</td>
|
28 |
<td style='text-align: center'>18.3GB</td>
|
29 |
</tr>
|
30 |
<tr>
|
31 |
<td style='text-align: center'>q3_K_M</td>
|
32 |
+
<td style='text-align: center'>10.6GB</td>
|
33 |
<td style='text-align: center'>16.1GB</td>
|
34 |
</tr>
|
35 |
<tr>
|
36 |
<td style='text-align: center'>q2_K</td>
|
37 |
+
<td style='text-align: center'>9.22GB</td>
|
38 |
<td style='text-align: center'>14.5GB</td>
|
39 |
</tr>
|
40 |
</tbody>
|