Update README.md
Browse files
README.md
CHANGED
@@ -28,7 +28,7 @@ During the pretraining phase of our large language model, the model was exposed
|
|
28 |
|
29 |
![image/png](https://framerusercontent.com/images/JWniDgAly6SFTvfdHtff0cLcnWY.png?scale-down-to=1024)
|
30 |
|
31 |
-
|
32 |
|
33 |
## License
|
34 |
|
|
|
28 |
|
29 |
![image/png](https://framerusercontent.com/images/JWniDgAly6SFTvfdHtff0cLcnWY.png?scale-down-to=1024)
|
30 |
|
31 |
+
We chose bfloat16 as training precision due to stability issues with float16 precision.
|
32 |
|
33 |
## License
|
34 |
|