How to save your custom files?

#27
by JaheimLee - opened

save_pretrained function from huggingface transformers can't save your custom files at the same time. So how to save them all instead of copying them maually after finetuning?

Mosaic ML, Inc. org

Sadly, HuggingFace does not make this easy. Here is a script we wrote which helps, but I agree it is not ideal https://github.com/mosaicml/llm-foundry/blob/main/scripts/inference/convert_composer_to_hf.py

sam-mosaic changed discussion status to closed

Sign up or log in to comment