bfloat16 vs float16
#1
by
lemon07r
- opened
Was looking at your yaml for this model and your previous version model, and noticed you switched datatypes from float16 to bfloat16. Was curious about the reason.
Previous one was a mistake. I looked at the models again ant they are all bfloat16.
Gotcha thanks! I wanted to copy your yaml config for a neural hermes + neural chat merge so I was curious what the difference was (I wont mind if you beat me to it though).
Weyaxi
changed discussion status to
closed