asyafiqe commited on
Commit
a9e6b87
1 Parent(s): ae72b29

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -15,7 +15,12 @@ language:
15
 
16
 
17
  ## Usage
18
- This model fit on 16GB VRAM GPU (Google Collab T4 wil do), by using BitsandBytes it can run on 6GB VRAM GPU
 
 
 
 
 
19
  Start chatting with Merak Mini Orca using the following code snippet:
20
  ```
21
  import torch
 
15
 
16
 
17
  ## Usage
18
+ This model fit on 16GB VRAM GPU (Google Collab T4 wil do), by using BitsandBytes it can run on 6GB VRAM GPU.
19
+
20
+ Quantized versions is available:
21
+ GPTQ: https://huggingface.co/asyafiqe/Merak-7B-v3-Mini-Orca-Indo-GPTQ
22
+ GGML/GGUF: I will try to make this version once GGUF merge is stable.
23
+
24
  Start chatting with Merak Mini Orca using the following code snippet:
25
  ```
26
  import torch