Convert flan-t5 to GGUF

by bogdan1 - opened Apr 1

Apr 1

Hi,

Great work for uploading this. I've been trying to convert a fine-tuned Flan-t5 model to GGUF without much success. Could you please also add here how you were able to convert it?

Thanks

bayang

DeepFile org Apr 1

Hi @bogdan1 this is how I did it: https://huggingface.co/lmz/candle-quantized-t5/discussions/3#6576536dd40e6ed3266551e4

bogdan1

Apr 2

Thanks a lot @bayang

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment