bfloat16 vs float16

#1
by lemon07r - opened

Was looking at your yaml for this model and your previous version model, and noticed you switched datatypes from float16 to bfloat16. Was curious about the reason.

Previous one was a mistake. I looked at the models again ant they are all bfloat16.

Gotcha thanks! I wanted to copy your yaml config for a neural hermes + neural chat merge so I was curious what the difference was (I wont mind if you beat me to it though).

Hi @lemon07r ,

Let me know if you are going to do it or not. Good luck :)

Weyaxi changed discussion status to closed

Sign up or log in to comment