float16
#2
by
maldv
- opened
Llama3 performance may be negatively impacted by conversion to float16. You should pretty much only be working in bfloat16 or float32 or the exponential precision loss breaks things.
Thanks! have possibly discovered the issue and will do bf16 going forward, probably redoing 33/3000 in the process with a v2.