File size: 893 Bytes
2a62b3b
 
d997d73
 
 
2a62b3b
d997d73
 
 
a4a5fb5
 
 
 
 
 
 
1defa8d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
---
license: mit
language:
- en
library_name: adapter-transformers
---

xriminact/TarsChattyBasev0.1 GGUF models converted using llama.cpp

| Tables        | Are           | Cool  |
| ------------- |:-------------:| -----:|
| col 3 is      | right-aligned | $1600 |
| col 2 is      | centered      |   $12 |
| zebra stripes | are neat      |    $1 |


widget:
  table:
      Name:
        - TarsChattyBasev0.1-Q4_K_M.gguf
        - TarsChattyBasev0.1-Q5_K_M.gguf
        - TarsChattyBasev0.1-Q8_0.gguf
      Quant Method:
        - Q4_K_M
        - Q5_K_M
        - Q8_0
      Bits:
        - 4
        - 5
        - 8
      Size:
        - 4.37 GB
        - 5.13 GB
        - 7.70 GB
      Max RAM required:
        - ~6.5 GB
        - ~7.5 GB
        - ~10.5 GB
      Use case
        - balanced quality
        - large, very low quality loss
        - very large, extremely low quality loss