Vision-CAIR commited on
Commit
2bb78c5
Β·
verified Β·
1 Parent(s): 663e91c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -51
README.md CHANGED
@@ -1,51 +1,9 @@
1
- # MiniGPT-Med: Large Language Model as a General Interface for Radiology Diagnosis
2
- Asma Alkhaldi, Raneem Alnajim, Layan Alabdullatef, Rawan Alyahya, Jun Chen, Deyao Zhu, Ahmed Alsinan, Mohamed Elhoseiny
3
-
4
- *Saudi Data and Artificial Intelligence Authority (SDAIA) and King Abdullah University of Science and Technology (KAUST)*
5
-
6
- ## Installation
7
- ```
8
- git clone https://github.com/Vision-CAIR/MiniGPT-Med
9
- cd MiniGPT-Med
10
- conda env create -f environment.yml
11
- conda activate miniGPT-Med
12
- ```
13
-
14
- ## Download miniGPT-Med trained model weights
15
-
16
- * miniGPT-Med's weights [miniGPT-Med Model](https://drive.google.com/file/d/1kjGLk6s9LsBmXfLWQFCdlwF3aul08Cl8/view?usp=sharing)
17
-
18
- * Then modify line 8 at miniGPT-Med/eval_configs/minigptv2_eval.yaml to be the path of miniGPT-Med weight.
19
-
20
- ## Prepare weight for LLMs
21
-
22
- ### Llama2 Version
23
-
24
- ```shell
25
- git clone https://huggingface.co/meta-llama/Llama-2-13b-chat-hf
26
- ```
27
-
28
- Then modify line 14 at miniGPT-Med/minigpt4/configs/models/minigpt_v2.yaml to be the path of Llama-2-13b-chat-hf.
29
-
30
- ## Launching Demo Locally
31
-
32
- ```
33
- python demo.py --cfg-path eval_configs/minigptv2_eval.yaml --gpu-id 0
34
- ```
35
-
36
- ## Dataset
37
- | Dataset | Images | json file|
38
- |---------|---------|----------|
39
- | MIMIC |[Download](https://physionet.org/content/mimiciii/1.4/) | [Download](https://drive.google.com/drive/folders/1nZhdfNoh7fkx7CWvf0_47_OLv3tA2m3o?usp=sharing) |
40
- | NLST |[Download](https://wiki.cancerimagingarchive.net/display/NLST)| [Downlaod](https://drive.google.com/drive/folders/1OKgMTaGLu_dWRuco6JipYzezw3oNwgaz?usp=sharing) |
41
- |SLAKE |[Downlaod](https://www.med-vqa.com/slake/) |[Download](https://drive.google.com/drive/folders/1vstjmfRbKahSAsi_b6FmTQiuolvgO8oC?usp=sharing)|
42
- |RSNA |[Downlaod](https://www.rsna.org/rsnai/ai-image-challenge/rsna-pneumonia-detection-challenge-2018) | [Download](https://drive.google.com/drive/folders/1wkXPvUNqda6jWAIduyiVJkS3Tx7P7td8?usp=sharing) |
43
- |Rad-VQA |[Downalod](https://osf.io/89kps/) |[Download](https://drive.google.com/drive/folders/1ING6Dodwk2DU_t4GHQYudNFMMg9OMfBQ?usp=sharing) |
44
-
45
- ## Acknowledgement
46
-
47
- - MiniGPT-4
48
- - Lavis
49
- - Vicuna
50
- - Falcon
51
- - Llama 2
 
1
+ ---
2
+ title: MiniGPT-Med
3
+ colorFrom: blue
4
+ colorTo: yellow
5
+ sdk: gradio
6
+ sdk_version: 4.27.0
7
+ app_file: app.py
8
+ pinned: false
9
+ ---