314B params has 297G file size ?

#30

by DachengZhang - opened Mar 18, 2024

Mar 18, 2024

Mar 18, 2024

QuantizedWeight8bit ?

Mar 18, 2024

@DachengZhang its quantized to 8 bit hence its 297gb

Mar 18, 2024

@DachengZhang its quantized to 8 bit hence its 297gb

ok,thanks!

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment