NouRed commited on
Commit
b9ae868
1 Parent(s): 0664c9f

add model card

Browse files
Files changed (1) hide show
  1. README.md +68 -0
README.md ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ tags:
4
+ - summarization
5
+ - bart
6
+ - medical question answering
7
+ - question understanding
8
+ - consumer health question
9
+ - prompt engineering
10
+ license: apache-2.0
11
+ datasets:
12
+ - bigbio/meqsum
13
+ widget:
14
+ - text: >-
15
+ SUBJECT: high inner eye pressure above 21 possible glaucoma
16
+
17
+ MESSAGE: have seen inner eye pressure increase as I have begin taking
18
+ Rizatriptan. I understand the med narrows blood vessels. Can this med. cause
19
+ or effect the closed or wide angle issues with the eyelense/glacoma.
20
+ model-index:
21
+ - name: medqsum-bart-large-xsum-meqsum
22
+ results: []
23
+ task:
24
+ - type: summarization
25
+ - name: Summarization
26
+ metrics:
27
+ - rouge
28
+ pipeline_tag: summarization
29
+ library_name: transformers
30
+ ---
31
+
32
+ ## Bart Xsum model finetuned on MeqSum
33
+ medqsum-bart-large-xsum-meqsum is the best fine-tuned model in the paper [Enhancing Large Language Models' Utility for Medical Question-Answering: A Patient Health Question Summarization Approach](), which introduces a solution to get the most out of LLMs, when answering health-related questions. We address the challenge of crafting accurate prompts by summarizing consumer health questions (CHQs) to generate clear and concise medical questions. Our approach involves fine-tuning Transformer-based models, including Flan-T5 in resource-constrained environments and three medical question summarization datasets.
34
+
35
+ ## Hyperparameters
36
+ ```json
37
+ {
38
+ "dataset_name": "MeQSum",
39
+ "learning_rate": 3e-05,
40
+ "model_name_or_path": "facebook/bart-large-xsum",
41
+ "num_train_epochs": 4,
42
+ "per_device_eval_batch_size": 4,
43
+ "per_device_train_batch_size": 4,
44
+ "predict_with_generate": true,
45
+ "seed": 7
46
+ }
47
+ ```
48
+
49
+ ## Usage
50
+ ```python
51
+ from transformers import pipeline
52
+ summarizer = pipeline("summarization", model="NouRed/medqsum-bart-large-xsum-meqsum")
53
+ chq = '''SUBJECT: high inner eye pressure above 21 possible glaucoma
54
+ MESSAGE: have seen inner eye pressure increase as I have begin taking
55
+ Rizatriptan. I understand the med narrows blood vessels. Can this med.
56
+ cause or effect the closed or wide angle issues with the eyelense/glacoma.
57
+ '''
58
+ summarizer(chq)
59
+ ```
60
+
61
+ ## Results
62
+
63
+ | key | value |
64
+ | --- | ----- |
65
+ | eval_rouge1 | 54.32 |
66
+ | eval_rouge2 | 38.08 |
67
+ | eval_rougeL | 51.98 |
68
+ | eval_rougeLsum | 51.99 |