Edit model card

Base model: westlake-repl/SaProt_650M_AF2

Dataset: SaProtHub/Dataset_Fluorescence_TAPE

Performance (on test set): 0.691 Spearman's ρ

LoRA config:

  • r: 8
  • lora_dropout: 0
  • lora_alpha: 8
  • target_modules: ["query", "key", "value", "intermediate.dense", "output.dense"]
  • modules_to_save: ["classifier"]

Training config:

  • optimizer:
    • class: AdamW
    • betas: (0.9, 0.98)
    • weight_decay: 0.01
  • learning rate: 1e-4
  • epoch: 50
  • batch size: 64
  • precision: 16-mixed
Downloads last month
0
Unable to determine this model's library. Check the docs .

Collection including SaProtHub/Model_Fluorescence_650M_lora