SaborDay commited on
Commit
01387be
1 Parent(s): 3752382

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -9
README.md CHANGED
@@ -5,10 +5,11 @@ language:
5
  base_model: microsoft/phi-2
6
  pipeline_tag: text-generation
7
  ---
8
-
9
  # Model Card for Model ID
 
10
 
11
- Model is a powerful language tool designed for scientific research. It specializes in analyzing clinical trial abstracts and sorts sentences into four key sections: Background, Methods, Results, and Conclusion.
12
  This makes it easier and faster for researchers to understand and organize important information from clinical studies.
13
 
14
 
@@ -85,13 +86,7 @@ bnb_config = BitsAndBytesConfig(load_in_4bit=True,
85
  r=16,
86
  lora_alpha=32,
87
  target_modules=[
88
- 'q_proj',
89
- 'k_proj',
90
- 'v_proj',
91
- 'dense',
92
- 'fc1',
93
- 'fc2',
94
- ],
95
  bias="none",
96
  lora_dropout=0.05,
97
  task_type="CAUSAL_LM",
 
5
  base_model: microsoft/phi-2
6
  pipeline_tag: text-generation
7
  ---
8
+ https://arxiv.org/abs/1710.06071
9
  # Model Card for Model ID
10
+ ![](image.png)
11
 
12
+ This is a small language model designed for scientific research. It specializes in analyzing clinical trial abstracts and sorts sentences into four key sections: Background, Methods, Results, and Conclusion.
13
  This makes it easier and faster for researchers to understand and organize important information from clinical studies.
14
 
15
 
 
86
  r=16,
87
  lora_alpha=32,
88
  target_modules=[
89
+ 'q_proj','k_proj','v_proj','dense','fc1','fc2'],
 
 
 
 
 
 
90
  bias="none",
91
  lora_dropout=0.05,
92
  task_type="CAUSAL_LM",