Script used to convert to int4 safe tensor

by Vezora - opened Feb 2

Vezora

Feb 2

Could you possibly please share the script used to convert the fp16 model to int4? Thank you! 🙏

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment