Why did you convert to float16 and not bfloat16?

by PhilipMay - opened 12 days ago

12 days ago

Hi,

is there a special reason why you store this model as float16 and not bfloat16?
Since the base model is in bfloat16...

Many thanks
Philip

Owner 12 days ago

Hi Philip, no particular reason for FP16

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment