GPU内存OOM

by chaiying - opened Jul 26, 2023

Jul 26, 2023

使用40G内存，half()，加载原生Llama-2-7b模型没问题，但是加载Chinese-Llama-2-7b报错，OOM了。

北京零速科技 org Jul 26, 2023

这不应该吧，用的是我们提供的代码吗？我们这边16G、24G、32G都能跑通的

shiyemin2 changed discussion status to closed Jul 28, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment