The documentation page MODEL_DOC/ROBERTA-PRELAYERNORM doesn’t exist in v4.47.1, but exists on the main version. Click here to redirect to the main version of the documentation.