IHaveNoClueAndIMustPost commited on
Commit
fb5ae76
1 Parent(s): ce3ef46

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -5
README.md CHANGED
@@ -10,7 +10,7 @@ This is [Llama2-22b](https://huggingface.co/chargoddard/llama2-22b) in a couple
10
  While I haven't had any issues so far do note that the original repo states <i>"Not intended for use as-is - this model is meant to serve as a base for further tuning"</b>.
11
 
12
  Approximate VRAM requirements at 4K context:
13
- <table style='border: 2px #000000 solid; width: 50%' align='left' border='2'>
14
  <tbody>
15
  <tr>
16
  <td style='text-align: center'>MODEL</td>
@@ -19,22 +19,22 @@ Approximate VRAM requirements at 4K context:
19
  </tr>
20
  <tr>
21
  <td style='text-align: center'>q5_1</td>
22
- <td style='text-align: center'>16GB</td>
23
  <td style='text-align: center'>21.5GB</td>
24
  </tr>
25
  <tr>
26
  <td style='text-align: center'>q4_K_M</td>
27
- <td style='text-align: center'>12.8GB</td>
28
  <td style='text-align: center'>18.3GB</td>
29
  </tr>
30
  <tr>
31
  <td style='text-align: center'>q3_K_M</td>
32
- <td style='text-align: center'>10.0GB</td>
33
  <td style='text-align: center'>16.1GB</td>
34
  </tr>
35
  <tr>
36
  <td style='text-align: center'>q2_K</td>
37
- <td style='text-align: center'>9.0GB</td>
38
  <td style='text-align: center'>14.5GB</td>
39
  </tr>
40
  </tbody>
 
10
  While I haven't had any issues so far do note that the original repo states <i>"Not intended for use as-is - this model is meant to serve as a base for further tuning"</b>.
11
 
12
  Approximate VRAM requirements at 4K context:
13
+ <table style='border: 2px #000000 solid; width: 20%' align='left' border='2'>
14
  <tbody>
15
  <tr>
16
  <td style='text-align: center'>MODEL</td>
 
19
  </tr>
20
  <tr>
21
  <td style='text-align: center'>q5_1</td>
22
+ <td style='text-align: center'>16.4GB</td>
23
  <td style='text-align: center'>21.5GB</td>
24
  </tr>
25
  <tr>
26
  <td style='text-align: center'>q4_K_M</td>
27
+ <td style='text-align: center'>13.2GB</td>
28
  <td style='text-align: center'>18.3GB</td>
29
  </tr>
30
  <tr>
31
  <td style='text-align: center'>q3_K_M</td>
32
+ <td style='text-align: center'>10.6GB</td>
33
  <td style='text-align: center'>16.1GB</td>
34
  </tr>
35
  <tr>
36
  <td style='text-align: center'>q2_K</td>
37
+ <td style='text-align: center'>9.22GB</td>
38
  <td style='text-align: center'>14.5GB</td>
39
  </tr>
40
  </tbody>