Update README.md
Browse files
README.md
CHANGED
@@ -19,4 +19,6 @@ The following hyperparameters were used
|
|
19 |
|---------:|-----:|-------------:|------------:|--------:|-----------:|-----------:|
|
20 |
| 128 | 3 | 8192 | 2e-5 | Cosine | 0. | 0.03 |
|
21 |
|
22 |
-
The model reached a training loss of 2.008 and took approximately 8 hours on 8x A100 80 GB GPUs.
|
|
|
|
|
|
19 |
|---------:|-----:|-------------:|------------:|--------:|-----------:|-----------:|
|
20 |
| 128 | 3 | 8192 | 2e-5 | Cosine | 0. | 0.03 |
|
21 |
|
22 |
+
The model reached a training loss of 2.008 and took approximately 8 hours on 8x A100 80 GB GPUs.
|
23 |
+
|
24 |
+
The specific training script can be found [here](https://github.com/hooloovoo-ai/cyoa-backend/blob/master/backend/scripts/train.py).
|