Dosen't work with model = model.half().quantize(8).cuda()

by Sanglujun - opened May 8, 2023

May 8, 2023

Question: 对下面中文拼写纠错：\n少先队员因该为老人让坐。\n答：
Response: 该句子的中文拼写是正确的。少先队员应该为老人让坐。

必须是model = model.half().cuda() # fp16 吗？

Owner May 10, 2023

训练时用的model.half().cuda()

May 11, 2023

升级显存后用半精度就跟训练的数据一样了，谢谢

Sanglujun changed discussion status to closed May 11, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment