Fixed incorrect BnB 4bit quantization written as INT4 instead of FP4/NF4

#15

by iAkashPaul - opened Mar 13

←

Mar 13

•

Cohere For AI org Mar 13

Thanks for the warning! Fixed it.

ahmetustun changed pull request status to closed Mar 13

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment