虽然支持32768的上下文但是为啥输入token大于4k就会报oom的错误？？？

by hellohaitao - opened Mar 4

Mar 4

虽然支持32768的上下文但是为啥输入token大于4k就会报oom的错误？？？

Apr 3

oom是显存爆了吧，不是模型oom

Pb-207

Apr 7

虽然支持32768的上下文但是为啥输入token大于4k就会报oom的错误？？？
你显存爆了。

jklj077 changed discussion status to closed Apr 18

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment