jinaai
/

jina-bert-v2-qk-post-norm

🇪🇺 Region: EU

Model card Files Files and versions Community

Jackmin108 commited on Dec 4, 2023

Commit

f713825

•

1 Parent(s): 84441b5

Update modeling_bert.py

Files changed (1) hide show

modeling_bert.py +1 -1

modeling_bert.py CHANGED Viewed

@@ -431,7 +431,7 @@ class JinaBertSelfAttention(nn.Module):
         context_layer = context_layer.view(new_context_layer_shape)
         outputs = (
-            (context_layer, attention_probs) if output_attentions else (context_layer,)
         )
         if self.is_decoder:

         context_layer = context_layer.view(new_context_layer_shape)
         outputs = (
+            (context_layer, attention_scores) if output_attentions else (context_layer,)
         )
         if self.is_decoder: