EdGoh95/WolfSSL-ROBERTa

This model is a Robustly Optimized Bidirectional Encoder Representations from Transformers approach (ROBERTa) model trained on a programming language code - WolfSSL.

The programming language used is C/C++, but the actual inference can also be used on other programming languages.

Using the model to unmask can be done in the following way:

from transformers import pipeline
unmasked = pipeline('fill-mask', model = 'EdGoh95/WolfSSL-ROBERTa')
unmasked("Hello I'm a <mask> model.")

To obtain the embeddings for downstream tasks:

# Import the model via the huggingface library
from transformers import AutoTokenizer, AutoModelForMaskedLM
# Load the tokenizer and the model for use by the pre-trained WolfSSL-ROBERTa model
tokenizer = AutoTokenizer.from_pretrained('EdGoh95/WolfSSL-ROBERTa')