stefan-it

/

umt5-small

like 0

hey @stefan-it i really appreciate all the hard work for merging umT5 to HF.

The umT5 model comes with a new sampling strategy called unimax that supposed to integrate with seqio on sampling dataset mixture.

was hoping if you have a way to implement the same or have link/resources for the same, as i believe the t5x and seqio repo haven't released the official code.