Make model tiny (172M -> 4.5M params)

#2
by lewtun HF staff - opened
Hugging Face Internal Testing Organization org
No description provided.
ydshieh changed pull request status to merged
Hugging Face Internal Testing Organization org

Hi Lewis, are these updates already merged? I still saw from the main branch the original large model that I previously uploaded for test purposes.

Hugging Face Internal Testing Organization org

Hi Jingya! According @lysandre , we should create and upload new tiny models, instead of making changes to the existing ones.

Hugging Face Internal Testing Organization org
edited Sep 20, 2022

Thanks @ydshieh ! Is hf-internal-testing/tiny-random-onnx-mt5 the new real tiny one for mt5?

Hugging Face Internal Testing Organization org

I would say yes. It is copied from @lewtun work described in https://github.com/huggingface/transformers/pull/18924.
However, I would suggest to have a discussion with him to make sure. The plan seems to change.

(But you can test with hf-internal-testing/tiny-random-onnx-mt5 if you want :-) )

Hugging Face Internal Testing Organization org

Tests passed for optimum, I will suggest a contributor to use the onnx one. If the plan changes in the future, I can update the test of optimum then if needed. Thanks for the replies @ydshieh !

Sign up or log in to comment