bf16 vs fp16
#10
by
Totole
- opened
Hi!
For bge v2 m3, do you recommend to use bf16 or fp16 ?
What are your conclusion about time performance ? And about accuracy ?
We fine-tune the model with fp16, so employing fp16 is preferable.
Using fp16 can save a lot of time, with minimal impact on accuracy.