model conversion / fp16
#6
by
julia62729
- opened
Hi! First, many thanks for all your work! You absolutely rock!
Could you maybe share the parameters/process you're using to convert models to gguf? I'm a little unsure the vocabulary stuff...
Also as a suggestion maybe you could upload fp16 versions at least for some of the small 7b models?