Update README.md
Browse files
README.md
CHANGED
|
@@ -31,7 +31,7 @@ BioTATA 7B V1 is a hybrid model merged between BioMistral 7B Dare and a 4bit QLO
|
|
| 31 |
- **License:** Apache 2.0
|
| 32 |
- **Finetuned from model:** BioMistral 7B Dare
|
| 33 |
|
| 34 |
-
### Model Sources
|
| 35 |
|
| 36 |
<!-- Provide the basic links for the model. -->
|
| 37 |
|
|
@@ -157,7 +157,7 @@ kimou605/TATA-NOTATA-FineMistral-nucleotide_transformer_downstream_tasks
|
|
| 157 |
|
| 158 |
- **Training regime:** BF16 4bits <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
| 159 |
|
| 160 |
-
#### Speeds, Sizes, Times
|
| 161 |
|
| 162 |
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
| 163 |
7h/ epoch
|
|
|
|
| 31 |
- **License:** Apache 2.0
|
| 32 |
- **Finetuned from model:** BioMistral 7B Dare
|
| 33 |
|
| 34 |
+
### Model Sources
|
| 35 |
|
| 36 |
<!-- Provide the basic links for the model. -->
|
| 37 |
|
|
|
|
| 157 |
|
| 158 |
- **Training regime:** BF16 4bits <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
| 159 |
|
| 160 |
+
#### Speeds, Sizes, Times
|
| 161 |
|
| 162 |
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
| 163 |
7h/ epoch
|