Hugging Face's logo

YeungNLP
/
bert-from-clip-chinese-1M

Feature Extraction
Transformers
PyTorch
bert
text-embeddings-inference
Inference Endpoints
Model card Files Community
1
Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

bert-from-clip-chinese pretrained model

该预训练权重是从BertCLIP预训练模型中单独取出来的Bert的权重，BertCLIP是中文版本的CLIP预训练模型，基于LiT-tuning（Locked-image Text tuning）的策略， 使用140万中文图文对数据进行多模态对比学习预训练。

Github: CLIP-Chinese

Bolg: CLIP-Chinese：中文多模态对比学习CLIP预训练模型

Usage

可以直接使用Huggingface的BertModel直接加载该预训练权重，进行下游的任务。

from transformers import BertTokenizer, BertModel

model_name_or_path = 'YeungNLP/bert-from-clip-chinese-1M'
tokenizer = BertTokenizer.from_pretrained(model_name_or_path)
model = BertModel.from_pretrained(model_name_or_path)
Downloads last month
15
Inference Examples
Feature Extraction
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.