zeren commited on
Commit
8595296
1 Parent(s): 4b9b5b6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -1
README.md CHANGED
@@ -165,4 +165,30 @@ print(out_text)
165
  | MMLU_tr-v0.2 | 49.11 |
166
  | TruthfulQA_tr-v0.2 | 48.51 |
167
  | Winogrande _tr-v0.2 | 54.98 |
168
- | GSM8k_tr-v0.2 | 51.78 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
165
  | MMLU_tr-v0.2 | 49.11 |
166
  | TruthfulQA_tr-v0.2 | 48.51 |
167
  | Winogrande _tr-v0.2 | 54.98 |
168
+ | GSM8k_tr-v0.2 | 51.78 |
169
+
170
+ ## Considerations on Limitations, Risks, Bias, and Ethical Factors
171
+
172
+ ### Limitations and Recognized Biases
173
+
174
+ - **Core Functionality and Usage:** KocDigital LLM, functioning as an autoregressive language model, is primarily purposed for predicting the subsequent token within a text sequence. Although commonly applied across different contexts, it's crucial to acknowledge that comprehensive real-world testing has not been conducted. Therefore, its efficacy and consistency in diverse situations are largely unvalidated.
175
+
176
+ - **Language Understanding and Generation:** The model's training is mainly focused on standard English and Turkish. Its proficiency in grasping and generating slang, colloquial language, or different languages might be restricted, possibly resulting in errors or misinterpretations.
177
+
178
+ - **Production of Misleading Information:** Users should acknowledge that KocDigital LLM might generate incorrect or deceptive information. Results should be viewed as initial prompts or recommendations rather than absolute conclusions.
179
+
180
+ ### Ethical Concerns and Potential Risks
181
+
182
+ - **Risk of Misuse:** KocDigital LLM carries the potential for generating language that could be offensive or harmful. We strongly advise against its utilization for such purposes and stress the importance of conducting thorough safety and fairness assessments tailored to specific applications before implementation.
183
+
184
+ - **Unintended Biases and Content:** The model underwent training on a vast corpus of text data without explicit vetting for offensive material or inherent biases. Consequently, it may inadvertently generate content reflecting these biases or inaccuracies.
185
+
186
+ - **Toxicity:** Despite efforts to curate appropriate training data, the model has the capacity to produce harmful content, particularly when prompted explicitly. We encourage active participation from the open-source community to devise strategies aimed at mitigating such risks.
187
+
188
+ ### Guidelines for Secure and Ethical Utilization
189
+
190
+ - **Human Oversight:** We advocate for the integration of a human oversight mechanism or the utilization of filters to oversee and enhance the quality of outputs, particularly in applications accessible to the public. This strategy can assist in minimizing the likelihood of unexpectedly generating objectionable content.
191
+
192
+ - **Tailored Testing for Specific Applications:** Developers planning to utilize KocDigital LLM should execute comprehensive safety assessments and optimizations customized to their unique applications. This step is essential as the model's responses may exhibit unpredictability and occasional biases, inaccuracies, or offensive outputs.
193
+
194
+ - **Responsible Development and Deployment:** Developers and users of KocDigital LLM bear the responsibility for ensuring its ethical and secure application. We encourage users to be cognizant of the model's limitations and to implement appropriate measures to prevent misuse or adverse outcomes.