Update README.md
Browse files
README.md
CHANGED
@@ -13,9 +13,9 @@ As an experimental feature in the model, there is an optional list size that can
|
|
13 |
|
14 |
`{'summary': ['point1', 'point2', 'point3']}`
|
15 |
|
16 |
-
This model is fine-tuned on top of [**llmware/bling-stable-lm-3b-4e1t-v0**](https://huggingface.co/llmware/bling-stable-lm-3b-4e1t-v0), which in turn, is a fine-tune of stabilityai/stablelm-3b-4elt.
|
17 |
|
18 |
-
|
19 |
|
20 |
|
21 |
## Prompt format:
|
|
|
13 |
|
14 |
`{'summary': ['point1', 'point2', 'point3']}`
|
15 |
|
16 |
+
This model is 2.7B parameters, small enough to run on a CPU, and is fine-tuned on top of [**llmware/bling-stable-lm-3b-4e1t-v0**](https://huggingface.co/llmware/bling-stable-lm-3b-4e1t-v0), which in turn, is a fine-tune of stabilityai/stablelm-3b-4elt.
|
17 |
|
18 |
+
For fast inference use of this model, we would recommend using the 'quantized tool' version, e.g., [**'slim-summary-tool'**](https://huggingface.co/llmware/slim-summary-tool).
|
19 |
|
20 |
|
21 |
## Prompt format:
|