请问多少张显卡可以微调BELLE-7B-2M模型

#2
by gyh1234 - opened

单张A100微调爆卡

gyh1234 changed discussion status to closed

混合精度(+Adam)的话需要16倍模型大小的显存才能放下,起码要112GB。

Sign up or log in to comment