How to use distilbert/distilbert-base-uncased with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="distilbert/distilbert-base-uncased")
# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("distilbert/distilbert-base-uncased") model = AutoModelForMaskedLM.from_pretrained("distilbert/distilbert-base-uncased", device_map="auto")
Internal model structure here: https://distilbert-distilbert-base-uncased.app.svetoviz.com/
· Sign up or log in to comment
