Temporarily disable the inference widget
Browse files
README.md
CHANGED
@@ -58,12 +58,7 @@ widget:
|
|
58 |
<|im_start|>user
|
59 |
Question: What is the color of an apple?<|im_end|>
|
60 |
<|im_start|>assistant
|
61 |
-
inference:
|
62 |
-
parameters:
|
63 |
-
max_new_tokens: 250
|
64 |
-
penalty_alpha: 0.5
|
65 |
-
top_k: 5
|
66 |
-
repetition_penalty: 1.001
|
67 |
---
|
68 |
|
69 |
# Locutusque's TinyMistral-248M trained on OpenAssistant TOP-1 Conversation Threads
|
@@ -74,6 +69,12 @@ inference:
|
|
74 |
- GGUF: [Felladrin/gguf-TinyMistral-248M-SFT-v4](https://huggingface.co/Felladrin/gguf-TinyMistral-248M-SFT-v4)
|
75 |
- ONNX: [Felladrin/onnx-TinyMistral-248M-SFT-v4](https://huggingface.co/Felladrin/onnx-TinyMistral-248M-SFT-v4)
|
76 |
|
|
|
|
|
|
|
|
|
|
|
|
|
77 |
## Recommended Prompt Format
|
78 |
|
79 |
```
|
|
|
58 |
<|im_start|>user
|
59 |
Question: What is the color of an apple?<|im_end|>
|
60 |
<|im_start|>assistant
|
61 |
+
inference: false
|
|
|
|
|
|
|
|
|
|
|
62 |
---
|
63 |
|
64 |
# Locutusque's TinyMistral-248M trained on OpenAssistant TOP-1 Conversation Threads
|
|
|
69 |
- GGUF: [Felladrin/gguf-TinyMistral-248M-SFT-v4](https://huggingface.co/Felladrin/gguf-TinyMistral-248M-SFT-v4)
|
70 |
- ONNX: [Felladrin/onnx-TinyMistral-248M-SFT-v4](https://huggingface.co/Felladrin/onnx-TinyMistral-248M-SFT-v4)
|
71 |
|
72 |
+
## Where to try out this model
|
73 |
+
|
74 |
+
The [inference widget from HuggingFace was not working properly for this model](https://discuss.huggingface.co/t/api-endpoint-not-working-as-expected/69457), so it was temporarily disabled.
|
75 |
+
|
76 |
+
To try out this model online, please visit this HuggingFace Space: [Felladrin/ModelsPlayground](https://huggingface.co/spaces/Felladrin/ModelsPlayground)
|
77 |
+
|
78 |
## Recommended Prompt Format
|
79 |
|
80 |
```
|