SinclairSchneider
/

dbrx-base-quantization-fixed

Text Generation

text-generation-inference

Model card Files Files and versions Community

winglian commited on Apr 1

Commit

3f5546e

•

1 Parent(s): 4bee1a6

reduce verbosity of logging

Files changed (1) hide show

modeling_dbrx.py +1 -1

modeling_dbrx.py CHANGED Viewed

@@ -411,7 +411,7 @@ class DbrxFlashAttention2(DbrxAttention):
         **kwargs: Any,
     ) -> Tuple[torch.Tensor, Optional[torch.Tensor],
                Optional[Tuple[torch.Tensor]]]:
-        logger.info(
             'Implicitly setting `output_attentions` to False as it is not supported in Flash Attention.'
         )
         output_attentions = False

         **kwargs: Any,
     ) -> Tuple[torch.Tensor, Optional[torch.Tensor],
                Optional[Tuple[torch.Tensor]]]:
+        logger.debug(
             'Implicitly setting `output_attentions` to False as it is not supported in Flash Attention.'
         )
         output_attentions = False