Hugging Face's logo

Crataco
/
Pygmalion-6B-GGML

Text Generation
English
conversational
gpt-j
ggml
Model card Files Community
Crataco commited on
Commit
6be5b00
•
1 Parent(s): 039d95e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -1
README.md CHANGED
@@ -14,7 +14,14 @@ inference: false
14
  ### This repository contains quantized conversions of the current Pygmalion 6B checkpoints.
15
  *For use with frontends that support GGML quantized GPT-J models, such as KoboldCpp and Oobabooga (with the CTransformers loader).*
16
 
17
- For the main (experiment 2, 2023-01-13) checkpoint, see the [main](https://huggingface.co/Crataco/Pygmalion-6B-GGML/tree/main) branch. For the dev (experiment 7, 2023-03-12) checkpoint, see the [dev](https://huggingface.co/Crataco/Pygmalion-6B-GGML/tree/dev) branch.
 
 
 
 
 
 
 
18
 
19
  The original model card can be found below.
20
 
 
14
  ### This repository contains quantized conversions of the current Pygmalion 6B checkpoints.
15
  *For use with frontends that support GGML quantized GPT-J models, such as KoboldCpp and Oobabooga (with the CTransformers loader).*
16
 
17
+ Model | Startup RAM usage (KoboldCpp) | Startup RAM usage (Oobabooga)
18
+ :--:|:--:|:--:
19
+ pygmalion-6b-main.q4_0.bin | Placeholder | Placeholder
20
+ pygmalion-6b-main.q4_1.bin | Placeholder | Placeholder
21
+ pygmalion-6b-main.q5_0.bin | Placeholder | Placeholder
22
+ pygmalion-6b-main.q5_1.bin | Placeholder | Placeholder
23
+ pygmalion-6b-main.q8_0.bin | Placeholder | Placeholder
24
+ pygmalion-6b-main.f16.bin | Placeholder | Placeholder
25
 
26
  The original model card can be found below.
27