The documentation page MODEL_DOC/ROBERTA-PRELAYERNORM doesn’t exist in v4.47.0, but exists on the main version. Click here to redirect to the main version of the documentation.