This model has 1 file scanned as unsafe.
- attn_loss_fn=cos, attn_weight=25.0, layer_mapper=all, projector=linear
- attn_loss_fn=cos, attn_weight=25.0, layer_mapper=all, projector=orthogonal
- attn_loss_fn=cos, attn_weight=25.0, layer_mapper=last, projector=linear
- attn_loss_fn=cos, attn_weight=25.0, layer_mapper=last_k_2, projector=linear
- attn_loss_fn=cos, attn_weight=25.0, layer_mapper=last_k_2, projector=orthogonal
- attn_loss_fn=cos, attn_weight=25.0, layer_mapper=layer-2, projector=linear
- attn_loss_fn=cos, attn_weight=5, layer_mapper=all, projector=linear
- attn_loss_fn=cos, attn_weight=5, layer_mapper=all, projector=orthogonal
- attn_loss_fn=cos, attn_weight=5, layer_mapper=last, projector=linear
- attn_loss_fn=cos, attn_weight=5, layer_mapper=last, projector=orthogonal
- attn_loss_fn=cos, attn_weight=5, layer_mapper=last_k_2, projector=linear
- attn_loss_fn=cos, attn_weight=5, layer_mapper=last_k_2, projector=orthogonal
- attn_loss_fn=cos, attn_weight=5, layer_mapper=layer-2, projector=linear
- attn_loss_fn=kl, attn_weight=5, layer_mapper=all, projector=linear