fp16 merge from this model checkpoint
#1
by
Jongsim
- opened
Hello, I am a developer using unsloth.
SFT is completed, but when I try to "merge_16bit" from the lora checkpoint, an error occurs offline. Is there any guide?
It is obviously offline, but an error occurs in HFFileSystem and an error related to http communication occurs.
Error in saving_ utils of unsloth_zoo and the functions used are _merge_and_overwrite_lora, _merge_lora