Metrics

• loss: 0.8263
• accuracy: 0.7947
• precision: 0.7915
• recall: 0.7947
• precision_macro: 0.5673
• recall_macro: 0.5767
• macro_fpr: 0.0183
• weighted_fpr: 0.0181
• weighted_specificity: 0.9749
• macro_specificity: 0.9846
• weighted_sensitivity: 0.7947
• macro_sensitivity: 0.5767
• f1_micro: 0.7947
• f1_macro: 0.5671
• f1_weighted: 0.7886
• runtime: 35.4093
• samples_per_second: 36.4590
• steps_per_second: 4.5750

legal-InLegal-merge-slerp

legal-InLegal-merge-slerp is a merge of the following models using mergekit:

• xshubhamx/legal-bert-base-uncased
• xshubhamx/InLegalBERT

🧩 Configuration

slices:
  - sources:
      - model: xshubhamx/legal-bert-base-uncased
        layer_range: [0, 11]
      - model: xshubhamx/InLegalBERT
        layer_range: [0, 11]
merge_method: slerp
base_model: xshubhamx/legal-bert-base-uncased
parameters:
  t:
    - filter: self_attn
      value: [0, 0.5, 0.3, 0.7, 1]
    - filter: mlp
      value: [1, 0.5, 0.7, 0.3, 0]
    - value: 0.5
dtype: bfloat16