Cab you do text summary with this just like with T5?

#2
by Stromal - opened

I have looked around but I cant find text summary option in any of the flan-T5 documentation.
Thx for the help.

Google org

Hey @Stromal !
I have played a bit with this Spaces: https://huggingface.co/spaces/osanseviero/i-like-flan/tree/main and managed to get some summaziation tasks working with flan-t5. For example if you try to prompt:

Summarize the following text: Peter and Elizabeth took a taxi to attend the night party in the city. While in the party, Elizabeth collapsed and was rushed to the hospital. Since she was diagnosed with a brain injury, the doctor told Peter to stay besides her until she gets well. Therefore, Peter stayed with her at the hospital for 3 days without leaving.

You get:

Peter and Elizabeth went to a party together. Elizabeth collapsed and was rushed to the hospital. Peter stayed with her at the hospital for 3 days.

Which is quite nice! I am unsure though if there is a specific format to use for summarization in T5-like models (aka if you have to pre-prend something very specific as in T5) - feel free to try it out and share some of the results here!

@ybelkada Awesome! Thank you :D

Hi @Stromal
You can also use https://huggingface.co/philschmid/flan-t5-base-samsum model to summarize
You can also refer to the article written by same person, how to understand how did he fine tuned model https://www.philschmid.de/fine-tune-flan-t5

Sign up or log in to comment