Commit
•
ffb1723
1
Parent(s):
155c7c3
Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ license: mit
|
|
9 |
---
|
10 |
|
11 |
# Model Description
|
12 |
-
ClinicalMobileBERT is the result of training the [BioMobileBERT](https://huggingface.co/
|
13 |
|
14 |
# Initialisation
|
15 |
We initialise our model with the pre-trained checkpoints of the [BioMobileBERT](https://huggingface.co/google/nlpie/bio-mobilebert) model available on Huggingface.
|
|
|
9 |
---
|
10 |
|
11 |
# Model Description
|
12 |
+
ClinicalMobileBERT is the result of training the [BioMobileBERT](https://huggingface.co/nlpie/bio-mobilebert) model in a continual learning scenario for 3 epochs using a total batch size of 192 on the MIMIC-III notes dataset.
|
13 |
|
14 |
# Initialisation
|
15 |
We initialise our model with the pre-trained checkpoints of the [BioMobileBERT](https://huggingface.co/google/nlpie/bio-mobilebert) model available on Huggingface.
|