Update README.md
Browse files
README.md
CHANGED
@@ -5,10 +5,11 @@ language:
|
|
5 |
base_model: microsoft/phi-2
|
6 |
pipeline_tag: text-generation
|
7 |
---
|
8 |
-
|
9 |
# Model Card for Model ID
|
|
|
10 |
|
11 |
-
|
12 |
This makes it easier and faster for researchers to understand and organize important information from clinical studies.
|
13 |
|
14 |
|
@@ -85,13 +86,7 @@ bnb_config = BitsAndBytesConfig(load_in_4bit=True,
|
|
85 |
r=16,
|
86 |
lora_alpha=32,
|
87 |
target_modules=[
|
88 |
-
'q_proj',
|
89 |
-
'k_proj',
|
90 |
-
'v_proj',
|
91 |
-
'dense',
|
92 |
-
'fc1',
|
93 |
-
'fc2',
|
94 |
-
],
|
95 |
bias="none",
|
96 |
lora_dropout=0.05,
|
97 |
task_type="CAUSAL_LM",
|
|
|
5 |
base_model: microsoft/phi-2
|
6 |
pipeline_tag: text-generation
|
7 |
---
|
8 |
+
https://arxiv.org/abs/1710.06071
|
9 |
# Model Card for Model ID
|
10 |
+
![](image.png)
|
11 |
|
12 |
+
This is a small language model designed for scientific research. It specializes in analyzing clinical trial abstracts and sorts sentences into four key sections: Background, Methods, Results, and Conclusion.
|
13 |
This makes it easier and faster for researchers to understand and organize important information from clinical studies.
|
14 |
|
15 |
|
|
|
86 |
r=16,
|
87 |
lora_alpha=32,
|
88 |
target_modules=[
|
89 |
+
'q_proj','k_proj','v_proj','dense','fc1','fc2'],
|
|
|
|
|
|
|
|
|
|
|
|
|
90 |
bias="none",
|
91 |
lora_dropout=0.05,
|
92 |
task_type="CAUSAL_LM",
|