README.md · chuhac/BiomedCLIP-vit-bert-hf at main

metadata

license: mit
language:
  - en
pipeline_tag: zero-shot-classification

Huggingface-friendly BiomedCLIP

pure torch and huggingface-based implementation of the original microsoft/BiomedCLIP-PubMedBERT_256-vit_base_patch16_224
rename the checkpoint state key names.

Usage

from transformers import AutoModel, AutoProcessor

model = AutoModel.from_pretrained("chuhac/BiomedCLIP-vit-bert-hf", trust_remote_code=True)
processor = AutoProcessor.from_pretrained("chuhac/BiomedCLIP-vit-bert-hf", trust_remote_code=True)