demo_regression / README.md
CluelessNovice's picture
Upload adapter model
481eb42
metadata
base_model: westlake-repl/SaProt_35M_AF2
library_name: peft

Model Card for Model-demo-35M

This model is used for a demo classification task

Task type

Protein-level Regression

Model input type

SA Sequence

Label meanings

A, B

LoRA config

  • r: 8
  • lora_dropout: 0.0
  • lora_alpha: 16
  • target_modules: ['value', 'intermediate.dense', 'key', 'query', 'output.dense']
  • modules_to_save: ['classifier']

Training config

  • optimizer:
    • class: AdamW
    • betas: (0.9, 0.98)
    • weight_decay: 0.01
  • learning rate: 0.001
  • epoch: 1
  • batch size: 2
  • precision: 16-mixed