Update README.md
Browse files
README.md
CHANGED
@@ -18,14 +18,12 @@ BLING models are fine-tuned with distilled high-quality custom instruct datasets
|
|
18 |
|
19 |
<!-- Provide a longer summary of what this model is. -->
|
20 |
|
21 |
-
|
22 |
-
|
23 |
-
- **
|
24 |
-
- **
|
25 |
-
- **
|
26 |
-
- **
|
27 |
-
- **License:** [More Information Needed]
|
28 |
-
- **Finetuned from model [optional]:** [More Information Needed]
|
29 |
|
30 |
### Model Sources [optional]
|
31 |
|
@@ -39,10 +37,26 @@ BLING models are fine-tuned with distilled high-quality custom instruct datasets
|
|
39 |
|
40 |
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
41 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
42 |
### Direct Use
|
43 |
|
44 |
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
45 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
46 |
[More Information Needed]
|
47 |
|
48 |
### Downstream Use [optional]
|
@@ -55,12 +69,20 @@ BLING models are fine-tuned with distilled high-quality custom instruct datasets
|
|
55 |
|
56 |
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
57 |
|
|
|
|
|
|
|
|
|
|
|
58 |
[More Information Needed]
|
59 |
|
60 |
## Bias, Risks, and Limitations
|
61 |
|
62 |
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
63 |
|
|
|
|
|
|
|
64 |
[More Information Needed]
|
65 |
|
66 |
### Recommendations
|
|
|
18 |
|
19 |
<!-- Provide a longer summary of what this model is. -->
|
20 |
|
21 |
+
- **Developed by:** llmware
|
22 |
+
- **Shared by [optional]:** Darren Oberst
|
23 |
+
- **Model type:** GPTNeoX instruct-trained decoder
|
24 |
+
- **Language(s) (NLP):** English
|
25 |
+
- **License:** Apache 2.0
|
26 |
+
- **Finetuned from model [optional]:** EleutherAI/Pythia-1b-deduped
|
|
|
|
|
27 |
|
28 |
### Model Sources [optional]
|
29 |
|
|
|
37 |
|
38 |
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
39 |
|
40 |
+
The intended use of BLING models is two-fold:
|
41 |
+
|
42 |
+
1. Provide a high-quality Instruct models that can run on a laptop for local testing. We have found it extremely useful when building a
|
43 |
+
proof-of-concept, or working with sensitive enterprise data that must be closely guarded, especially in RAG use cases.
|
44 |
+
|
45 |
+
2. Push the state of the art for smaller Instruct-following models in the 1B - 7B range.
|
46 |
+
|
47 |
### Direct Use
|
48 |
|
49 |
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
50 |
|
51 |
+
BLING is designed for enterprise automation use cases, especially in knowledge-intensive industries, such as financial services,
|
52 |
+
legal and regulatory industries. BLING is intended to be an experimental series of little instruct models targeted as specific
|
53 |
+
RAG automation tasks with complex information sources. Rather than try to be "all things to all people," BLING models try to focus
|
54 |
+
on a narrower set of Instructions more suitable to a ~1B parameter GPT model.
|
55 |
+
|
56 |
+
BLING is ideal for rapid prototyping, testing, and the ability to perform an end-to-end workflow locally on a laptop without
|
57 |
+
having to send sensitive information over an Internet-based API.
|
58 |
+
|
59 |
+
|
60 |
[More Information Needed]
|
61 |
|
62 |
### Downstream Use [optional]
|
|
|
69 |
|
70 |
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
71 |
|
72 |
+
1. BLING is not designed for 'chat-bot' or 'consumer-oriented' applications.
|
73 |
+
|
74 |
+
2. BLING is not optimal for most production applications, other than simple and highly specific use cases.
|
75 |
+
|
76 |
+
|
77 |
[More Information Needed]
|
78 |
|
79 |
## Bias, Risks, and Limitations
|
80 |
|
81 |
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
82 |
|
83 |
+
BLING has not been designed for end consumer-oriented applications, and there has been any focus in training on important safeguards to
|
84 |
+
mitigate potential bias and safety. We would strongly discourage any use of BLING for any 'chatbot' use case.
|
85 |
+
|
86 |
[More Information Needed]
|
87 |
|
88 |
### Recommendations
|