Inconsistency between model name and the model architecture from config.json

#3
by jiang784 - opened

Hello,

I was recently browsing nlln models on HuggingFace and I came across this model: "uer/t5-v1_1-base-chinese-cluecorpussmall". I noticed a discrepancy that I'd like to bring to your attention.

According to the model's name, it's supposed to be a NLLB model. However, in the config.json file, the model_type and architecture are labeled as 'mt5', not 't5'.

Here are the pertinent details:
Model name: uer/t5-v1_1-base-chinese-cluecorpussmall
model_type in config.json: mt5
architectures in config.json: MT5ForConditionalGeneration

I noticed that Hugging Face does provide a label for T5 models. This discrepancy could potentially lead to confusion when users are trying to understand the underlying architecture of this model.

I wanted to bring this to your attention in case it was an oversight. If it's not an oversight and there's a specific reason for this labeling, I'd appreciate it if you could clarify.

Thank you for your time and the work you've put into developing this model. I look forward to your response.

Sign up or log in to comment