这个模型推理需要多大的显存?

#6
by Chw6951 - opened

24G的单卡能跑吗?

Fengshenbang-LM org

单卡推理fp16大概需要8G显存左右, 24G单卡完全够用

Zimix changed discussion status to closed

Sign up or log in to comment