facebook

/

opt-66b

like 175

In the model card, it is recommended to load the model with model = AutoModel.from_pretrained('facebook/opt-66b', torch_dtype=torch.float16), but then I get this error during the forward pass.