README.md

Model details

Model type:

EasyGen is an open-source chatbot trained by fine-tuning FlanT5/Vicuna for multimodal conversation.

How to use it:

For lora model, the weights in base_model_for_lora file is the base model. You can use merge the lora weight in lora_weight file for image-to-text task and merge the lora weight in multimodal_dialogue_lora for multimodal dialogue generation.