kbressem commited on
Commit
9104e48
1 Parent(s): e2160cf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +74 -0
README.md CHANGED
@@ -1,3 +1,77 @@
1
  ---
2
  license: cc
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: cc
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - medical
9
  ---
10
+ # MedAlpaca 7b
11
+
12
+
13
+ ## Table of Contents
14
+
15
+ [Model Description](#model-description)
16
+ - [Architecture](#architecture)
17
+ - [Training Data](#trainig-data)
18
+ [Model Usage](#model-usage)
19
+ [Limitations](#limitations)
20
+
21
+ ## Model Description
22
+ ### Architecture
23
+ `medalpaca-7b` is a large language model specifically fine-tuned for medical domain tasks.
24
+ It is based on LLaMA (Large Language Model Meta AI) and contains 7 billion parameters.
25
+ The primary goal of this model is to improve question-answering and medical dialogue tasks.
26
+ Architecture
27
+
28
+
29
+ ### Training Data
30
+ The training data for this project was sourced from various resources.
31
+ Firstly, we used Anki flashcards to automatically generate questions,
32
+ from the front of the cards and anwers from the back of the card.
33
+ Secondly, we generated medical question-answer pairs from [Wikidoc](https://www.wikidoc.org/index.php/Main_Page).
34
+ We extracted paragraphs with relevant headings, and used Chat-GPT 3.5
35
+ to generate questions from the headings and using the corresponding paragraphs
36
+ as answers. This dataset is still under development and we believe
37
+ that approximately 70% of these question answer pairs are factual correct.
38
+ Thirdly, we used StackExchange to extract question-answer pairs, taking the
39
+ top-rated question from five categories: Academia, Bioinformatics, Biology,
40
+ Fitness, and Health. Additionally, we used a dataset from [ChatDoctor](https://arxiv.org/abs/2303.14070)
41
+ consisting of 200,000 question-answer pairs, available at https://github.com/Kent0n-Li/ChatDoctor.
42
+
43
+ | Source | n items |
44
+ |------------------------------|--------|
45
+ | ChatDoc large | 200000 |
46
+ | wikidoc | 67704 |
47
+ | Stackexchange academia | 40865 |
48
+ | Anki flashcards | 33955 |
49
+ | Stackexchange biology | 27887 |
50
+ | Stackexchange fitness | 9833 |
51
+ | Stackexchange health | 7721 |
52
+ | Wikidoc patient information | 5942 |
53
+ | Stackexchange bioinformatics | 5407 |
54
+
55
+ ## Model Usage
56
+ To evaluate the performance of the model on a specific dataset, you can use the Hugging Face Transformers library's built-in evaluation scripts. Please refer to the evaluation guide for more information.
57
+ Inference
58
+
59
+ You can use the model for inference tasks like question-answering and medical dialogues using the Hugging Face Transformers library. Here's an example of how to use the model for a question-answering task:
60
+
61
+ ```python
62
+
63
+ from transformers import pipeline
64
+
65
+ qa_pipeline = pipeline("question-answering", model="GerMedBERT/medalpaca-7b", tokenizer="GerMedBERT/medalpaca-7b")
66
+ question = "What are the symptoms of diabetes?"
67
+ context = "Diabetes is a metabolic disease that causes high blood sugar. The symptoms include increased thirst, frequent urination, and unexplained weight loss."
68
+ answer = qa_pipeline({"question": question, "context": context})
69
+ print(answer)
70
+ ```
71
+
72
+ ## Limitations
73
+ The model may not perform effectively outside the scope of the medical domain.
74
+ The training data primarily targets the knowledge level of medical students,
75
+ which may result in limitations when addressing the needs of board-certified physicians.
76
+ The model has not been tested in real-world applications, so its efficacy and accuracy are currently unknown.
77
+ It should never be used as a substitute for a doctor's opinion and must be treated as a research tool only.