Update README.md
#7
by
lucianodelcorro
- opened
README.md
CHANGED
@@ -13,11 +13,15 @@ license_link: LICENSE
|
|
13 |
|
14 |
<!-- Provide a quick summary of what the model is/does. -->
|
15 |
|
16 |
-
Orca 2 is
|
17 |
-
in tasks such as reasoning over user given data, reading comprehension, math problem solving and text summarization.
|
18 |
-
The model is designed to excel particularly in reasoning.
|
19 |
|
20 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
|
22 |
## What is Orca 2’s intended use(s)?
|
23 |
|
|
|
13 |
|
14 |
<!-- Provide a quick summary of what the model is/does. -->
|
15 |
|
16 |
+
Orca 2 is built for research purposes only and provides a single turn response in tasks such as reasoning over user given data, reading comprehension, math problem solving and text summarization. The model is designed to excel particularly in reasoning.
|
|
|
|
|
17 |
|
18 |
+
Note that:
|
19 |
+
|
20 |
+
1. This is a research model, intended to show that we can use capable models and complex workflows (advanced prompts, multiple calls) to create synthetic data that can teach Small Language Models (SLMs) new capabilities. We chose reasoning because it is a widely useful capability that SLMs lack.
|
21 |
+
2. The model is not optimized for chat and has not been trained with RLHF or DPO. It is best used after being finetuned for chat or for a specific task.
|
22 |
+
3. Beyond reasoning, the model inherits capabilities and limitations of its base (LLAMA-2 base). We have already seen that the benefits of the Orca training can be applied to other base model too.
|
23 |
+
|
24 |
+
We make Orca 2's weights publicly available to support further research on the development, evaluation, and alignment of SLMs.
|
25 |
|
26 |
## What is Orca 2’s intended use(s)?
|
27 |
|