Hugging Face's logo

rustformers
/
gpt-j-ggml

Text Generation
Transformers
English
llm-rs
ggml
Inference Endpoints
Model card Files Community
LLukas22 commited on
Commit
3921777
•
1 Parent(s): 95eb7eb

Generated README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -9,7 +9,7 @@ datasets:
9
  - the_pile
10
  ---
11
 
12
- # GGML covnerted Models of [EleutherAI](https://huggingface.co/EleutherAI)'s GPT-J model
13
 
14
  ## Description
15
 
@@ -44,6 +44,7 @@ GPT-2/GPT-3.
44
  | [gpt-j-6b-f16.bin](https://huggingface.co/rustformers/gpt-j-ggml/blob/main/gpt-j-6b-f16.bin) | [EleutherAI/gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | F16 | GGML | V3 |
45
  | [gpt-j-6b-q4_0.bin](https://huggingface.co/rustformers/gpt-j-ggml/blob/main/gpt-j-6b-q4_0.bin) | [EleutherAI/gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | Q4_0 | GGML | V3 |
46
  | [gpt-j-6b-q4_0-ggjt.bin](https://huggingface.co/rustformers/gpt-j-ggml/blob/main/gpt-j-6b-q4_0-ggjt.bin) | [EleutherAI/gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | Q4_0 | GGJT | V3 |
 
47
  | [gpt-j-6b-q5_1-ggjt.bin](https://huggingface.co/rustformers/gpt-j-ggml/blob/main/gpt-j-6b-q5_1-ggjt.bin) | [EleutherAI/gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | Q5_1 | GGJT | V3 |
48
 
49
  ## Usage
 
9
  - the_pile
10
  ---
11
 
12
+ # GGML converted versions of [EleutherAI](https://huggingface.co/EleutherAI)'s GPT-J model
13
 
14
  ## Description
15
 
 
44
  | [gpt-j-6b-f16.bin](https://huggingface.co/rustformers/gpt-j-ggml/blob/main/gpt-j-6b-f16.bin) | [EleutherAI/gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | F16 | GGML | V3 |
45
  | [gpt-j-6b-q4_0.bin](https://huggingface.co/rustformers/gpt-j-ggml/blob/main/gpt-j-6b-q4_0.bin) | [EleutherAI/gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | Q4_0 | GGML | V3 |
46
  | [gpt-j-6b-q4_0-ggjt.bin](https://huggingface.co/rustformers/gpt-j-ggml/blob/main/gpt-j-6b-q4_0-ggjt.bin) | [EleutherAI/gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | Q4_0 | GGJT | V3 |
47
+ | [gpt-j-6b-q5_1.bin](https://huggingface.co/rustformers/gpt-j-ggml/blob/main/gpt-j-6b-q5_1.bin) | [EleutherAI/gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | Q5_1 | GGML | V3 |
48
  | [gpt-j-6b-q5_1-ggjt.bin](https://huggingface.co/rustformers/gpt-j-ggml/blob/main/gpt-j-6b-q5_1-ggjt.bin) | [EleutherAI/gpt-j-6b](https://huggingface.co/EleutherAI/gpt-j-6b) | Q5_1 | GGJT | V3 |
49
 
50
  ## Usage