bert-base-uncased
This is the bert-base-uncased model converted to OpenVINO, for accellerated inference.
An example of how to do inference on this model:
from optimum.intel.openvino import OVModelForMaskedLM
from transformers import AutoTokenizer, pipeline
# model_id should be set to either a local directory or a model available on the HuggingFace hub.
model_id = "helenai/bert-base-uncased-ov-fp32"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = OVModelForMaskedLM.from_pretrained(model_id)
pipe = pipeline("fill-mask", model=model, tokenizer=tokenizer)
result = pipe("I am a [MASK] model")
print(result)
- Downloads last month
- 381
This model does not have enough activity to be deployed to Inference API (serverless) yet.
Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.