Hugging Face's logo

rustformers
/
bloom-ggml

Text Generation
Transformers
llm-rs
ggml
Inference Endpoints
Model card Files Community
LLukas22 commited on
Commit
7f130ff
•
1 Parent(s): 3b48635

Generated README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -77,6 +77,10 @@ BLOOM is an autoregressive Large Language Model (LLM), trained to continue text
77
  ## Converted Models
78
  | Name | Based on | Type | Container | GGML Version |
79
  |:-------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------|:-------|:------------|:---------------|
 
 
 
 
80
  | [bloom-1b7-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-f16.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | F16 | GGML | V3 |
81
  | [bloom-1b7-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q4_0 | GGML | V3 |
82
  | [bloom-1b7-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0-ggjt.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q4_0 | GGJT | V3 |
 
77
  ## Converted Models
78
  | Name | Based on | Type | Container | GGML Version |
79
  |:-------------------------------------------------------------------------------------------------------------|:----------------------------------------------------------------------|:-------|:------------|:---------------|
80
+ | [bloom-1b1-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b1-f16.bin) | [bigscience/bloom-1b1](https://huggingface.co/bigscience/bloom-1b1) | F16 | GGML | V3 |
81
+ | [bloom-1b1-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b1-q4_0.bin) | [bigscience/bloom-1b1](https://huggingface.co/bigscience/bloom-1b1) | Q4_0 | GGML | V3 |
82
+ | [bloom-1b1-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b1-q4_0-ggjt.bin) | [bigscience/bloom-1b1](https://huggingface.co/bigscience/bloom-1b1) | Q4_0 | GGJT | V3 |
83
+ | [bloom-1b1-q5_1-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b1-q5_1-ggjt.bin) | [bigscience/bloom-1b1](https://huggingface.co/bigscience/bloom-1b1) | Q5_1 | GGJT | V3 |
84
  | [bloom-1b7-f16.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-f16.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | F16 | GGML | V3 |
85
  | [bloom-1b7-q4_0.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q4_0 | GGML | V3 |
86
  | [bloom-1b7-q4_0-ggjt.bin](https://huggingface.co/rustformers/bloom-ggml/blob/main/bloom-1b7-q4_0-ggjt.bin) | [bigscience/bloom-1b7](https://huggingface.co/bigscience/bloom-1b7) | Q4_0 | GGJT | V3 |