The documentation page MODEL_DOC/ROBERTA-PRELAYERNORM doesn’t exist in v4.43.4, but exists on the main version. Click here to redirect to the main version of the documentation.