Edit model card



Language model: albert-tiny Model size: 16M Language: Chinese Training data: CLUECorpusSmall Eval data: CLUE dataset


For results on downstream tasks like text classification, please refer to this repository.


**NOTE:**Since sentencepiece is not used in albert_chinese_tiny model, you have to call BertTokenizer instead of AlbertTokenizer !!!

import torch
from transformers import BertTokenizer, AlbertModel
tokenizer = BertTokenizer.from_pretrained("clue/albert_chinese_tiny")
albert = AlbertModel.from_pretrained("clue/albert_chinese_tiny")

About CLUE benchmark

Organization of Language Understanding Evaluation benchmark for Chinese: tasks & datasets, baselines, pre-trained Chinese models, corpus and leaderboard.

Github: https://github.com/CLUEbenchmark Website: https://www.cluebenchmarks.com/

Downloads last month
Hosted inference API

Unable to determine this model’s pipeline type. Check the docs .