Update README.md
Browse files
README.md
CHANGED
@@ -15,7 +15,12 @@ language:
|
|
15 |
|
16 |
|
17 |
## Usage
|
18 |
-
This model fit on 16GB VRAM GPU (Google Collab T4 wil do), by using BitsandBytes it can run on 6GB VRAM GPU
|
|
|
|
|
|
|
|
|
|
|
19 |
Start chatting with Merak Mini Orca using the following code snippet:
|
20 |
```
|
21 |
import torch
|
|
|
15 |
|
16 |
|
17 |
## Usage
|
18 |
+
This model fit on 16GB VRAM GPU (Google Collab T4 wil do), by using BitsandBytes it can run on 6GB VRAM GPU.
|
19 |
+
|
20 |
+
Quantized versions is available:
|
21 |
+
GPTQ: https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GPTQ
|
22 |
+
GGML/GGUF: I will try to make this version once GGUF merge is stable.
|
23 |
+
|
24 |
Start chatting with Merak Mini Orca using the following code snippet:
|
25 |
```
|
26 |
import torch
|