Update README.md
Browse files
README.md
CHANGED
@@ -18,7 +18,7 @@ For full details of this model please read our [paper](https://arxiv.org/abs/240
|
|
18 |
|
19 |
## Model Training
|
20 |
Panacea is trained from [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1). The training of Panacea consists of an alignment step and an instruction-tuning step.
|
21 |
-
* Alignment step: continued pre-
|
22 |
* Instruction-tuning step: further enables Panacea to comprehend the user explanation of the task definition and the output requirement.
|
23 |
|
24 |
Load the model in the following way (same as Mistral):
|
|
|
18 |
|
19 |
## Model Training
|
20 |
Panacea is trained from [Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1). The training of Panacea consists of an alignment step and an instruction-tuning step.
|
21 |
+
* Alignment step: continued pre-training on a large collection of trial documents and trial-related scientific papers. This step adapts Panacea to the vocabulary commonly used in clinical trials.
|
22 |
* Instruction-tuning step: further enables Panacea to comprehend the user explanation of the task definition and the output requirement.
|
23 |
|
24 |
Load the model in the following way (same as Mistral):
|