Update README.md
Browse files
README.md
CHANGED
@@ -29,7 +29,7 @@ with a focus on low toxicity and high efficiency.
|
|
29 |
Given its small size and lack of training data for instruction alignment, kl3m-003-3.7b is best suited for use either in
|
30 |
SLM fine-tuning or as part of training larger models without using unethical data or models.
|
31 |
|
32 |
-
The model was originally trained between
|
33 |
being provided with complete source and data replication as part of the `kl3m-004` family to be released in Q1 2025.
|
34 |
|
35 |
## Source
|
|
|
29 |
Given its small size and lack of training data for instruction alignment, kl3m-003-3.7b is best suited for use either in
|
30 |
SLM fine-tuning or as part of training larger models without using unethical data or models.
|
31 |
|
32 |
+
The model was originally trained between February-March 2024 on a 4x8xH100-80G cluster in DDP. A similar model is
|
33 |
being provided with complete source and data replication as part of the `kl3m-004` family to be released in Q1 2025.
|
34 |
|
35 |
## Source
|