Hugging Face's logo

rustformers
/
dolly-v2-ggml

Text Generation
Transformers
English
gpt_neox
llm-rs
ggml
Inference Endpoints
text-generation-inference
Model card Files Community
2
LLukas22 commited on
Commit
7320e80
•
1 Parent(s): 55fd081

Generated README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -26,10 +26,12 @@ Dolly is trained on ~15k instruction/response fine tuning records databricks-dol
26
  | [dolly-v2-3b-f16.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-f16.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | F16 | GGML | V3 |
27
  | [dolly-v2-3b-q4_0.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q4_0.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q4_0 | GGML | V3 |
28
  | [dolly-v2-3b-q4_0-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q4_0-ggjt.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q4_0 | GGJT | V3 |
 
29
  | [dolly-v2-3b-q5_1-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q5_1-ggjt.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q5_1 | GGJT | V3 |
30
  | [dolly-v2-7b-f16.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-f16.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | F16 | GGML | V3 |
31
  | [dolly-v2-7b-q4_0.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q4_0.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q4_0 | GGML | V3 |
32
  | [dolly-v2-7b-q4_0-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q4_0-ggjt.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q4_0 | GGJT | V3 |
 
33
  | [dolly-v2-7b-q5_1-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q5_1-ggjt.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q5_1 | GGJT | V3 |
34
 
35
  ## Usage
 
26
  | [dolly-v2-3b-f16.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-f16.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | F16 | GGML | V3 |
27
  | [dolly-v2-3b-q4_0.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q4_0.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q4_0 | GGML | V3 |
28
  | [dolly-v2-3b-q4_0-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q4_0-ggjt.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q4_0 | GGJT | V3 |
29
+ | [dolly-v2-3b-q5_1.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q5_1.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q5_1 | GGML | V3 |
30
  | [dolly-v2-3b-q5_1-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-3b-q5_1-ggjt.bin) | [databricks/dolly-v2-3b](https://huggingface.co/databricks/dolly-v2-3b) | Q5_1 | GGJT | V3 |
31
  | [dolly-v2-7b-f16.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-f16.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | F16 | GGML | V3 |
32
  | [dolly-v2-7b-q4_0.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q4_0.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q4_0 | GGML | V3 |
33
  | [dolly-v2-7b-q4_0-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q4_0-ggjt.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q4_0 | GGJT | V3 |
34
+ | [dolly-v2-7b-q5_1.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q5_1.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q5_1 | GGML | V3 |
35
  | [dolly-v2-7b-q5_1-ggjt.bin](https://huggingface.co/rustformers/dolly-v2-ggml/blob/main/dolly-v2-7b-q5_1-ggjt.bin) | [databricks/dolly-v2-7b](https://huggingface.co/databricks/dolly-v2-7b) | Q5_1 | GGJT | V3 |
36
 
37
  ## Usage