omidrohanian
commited on
Commit
·
63845d8
1
Parent(s):
bca4031
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,38 @@
|
|
1 |
---
|
2 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
+
title: Llama2-MedTuned-7b
|
3 |
+
emoji: 🧬
|
4 |
+
colorFrom: blue
|
5 |
+
colorTo: green
|
6 |
+
sdk: static
|
7 |
+
pinned: false
|
8 |
+
license: mit
|
9 |
+
tags:
|
10 |
+
- 'biomedical '
|
11 |
+
- clinical
|
12 |
+
- medical
|
13 |
---
|
14 |
+
|
15 |
+
# Model Description
|
16 |
+
Llama2-MedTuned-7b is an instruction-tuned version of the Llama2 7B model, specifically adapted for biomedical language processing tasks. It has been fine-tuned on a dataset consisting of approximately 200,000 instruction-focused samples, covering a range of biomedical and clinical NLP tasks such as Named Entity Recognition (NER), Relation Extraction (RE), and Medical Natural Language Inference (NLI).
|
17 |
+
|
18 |
+
# Instruction Tuning Procedure
|
19 |
+
This model underwent instruction tuning, a process where the model is fine-tuned with detailed instructions to enhance its ability to interpret and execute specific tasks in the biomedical domain. The tuning involved the use of a comprehensive instruction-based dataset, tailor-made to align with the requirements of biomedical NLP tasks.
|
20 |
+
|
21 |
+
# Model Capabilities
|
22 |
+
Llama2-MedTuned-7b demonstrates an enhanced understanding of biomedical contexts, effectively handling NER, RE, and NLI tasks. It showcases improved accuracy in generating structured outputs suitable for evaluation using conventional metrics.
|
23 |
+
|
24 |
+
# Architecture
|
25 |
+
The architecture of Llama2-MedTuned-7b is based on the autoregressive transformer model Llama2 7B. This model maintains the original transformer layers and attention mechanisms, specifically adjusted to cater to the linguistic intricacies of the biomedical field.
|
26 |
+
|
27 |
+
# Citation
|
28 |
+
If you utilise Llama2-MedTuned-7b in your research or application, please consider citing our paper:
|
29 |
+
|
30 |
+
```bibtex
|
31 |
+
@misc{rohanian2023exploring,
|
32 |
+
title={Exploring the Effectiveness of Instruction Tuning in Biomedical Language Processing},
|
33 |
+
author={Omid Rohanian and Mohammadmahdi Nouriborji and David A. Clifton},
|
34 |
+
year={2023},
|
35 |
+
eprint={2401.00579},
|
36 |
+
archivePrefix={arXiv},
|
37 |
+
primaryClass={cs.CL}
|
38 |
+
}
|