What calibration dataset did you use to convert it?

by Samvanity - opened Jan 23

Jan 23

Hi,

was wondering what calibration dataset did you use to convert this? The default provided by exllamav2?

Thank you!

Owner Jan 24

Yes, anything that has been quantized since late 2023 would use the default calibration dataset.

Samvanity changed discussion status to closed Jan 31

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment