Spaces:
Running
on
CPU Upgrade
AI-Sweden-Models/gpt-sw3-40b marked with wrong metadata in the leaderboard
The leaderboard shows the wrong metadata. TheAI-Sweden-Models/gpt-sw3-40b model is:
- labeled as
fine-tunedbut the correct label should bepretrained - labeled as
float16but the correct label should bebfloat16
The model was added by hf staff when fixing a bug and that's the reason for the metadata difference. Hope the metadata can be updated!
Thank you for all your great work!
Hi!
I can fix the fine-tuned/pretrained, but are you sure the model was submitted in bfloat16 and not in float16? The precision displayed is for the evaluation, not the model (weights are cast to the requested precision on the fly).
Hi!
I can fix the fine-tuned/pretrained, but are you sure the model was submitted in bfloat16 and not in float16? The precision displayed is for the evaluation, not the model (weights are cast to the requested precision on the fly).
Thank you and then the model was submitted in float16!
Thought it was metadata, the original model was trained in bfloat16 but results seem in line with expectation so probably worked out well in the end.
Yep, there isn't a lot of difference between float16 and bfloat16 for most evaluations :)
Closing this issue, please wait for an hour for the modifs to be propagated to the leaderboard!