File size: 960 Bytes
67a5b45
 
 
 
 
 
 
 
0b2e6d7
67a5b45
17d0ab9
 
67a5b45
17d0ab9
 
67a5b45
0b2e6d7
17d0ab9
 
67a5b45
17d0ab9
 
67a5b45
17d0ab9
 
67a5b45
17d0ab9
67a5b45
17d0ab9
67a5b45
17d0ab9
67a5b45
17d0ab9
 
67a5b45
17d0ab9
67a5b45
17d0ab9
67a5b45
17d0ab9
67a5b45
17d0ab9
67a5b45
17d0ab9
67a5b45
17d0ab9
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
---
base_model: westlake-repl/SaProt_35M_AF2
library_name: peft
---

# Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->
This model is used to predict ACE2 binding affinities with mutant SARSCoV-2 Omicron XBB.1.5 variants spike receptor-binding domain (RBD). 

### Task type
protein level regression

### Dataset description
The dataset is from [Deep mutational scans of XBB.1.5 and BQ.1.1 reveal ongoing epistatic drift during SARSCoV-2 evolution](https://doi.org/10.1371/journal.ppat.1011901).

The label is the binding affinities level.
### Model input type
Amino acid sequence

### Performance
0.71 Spearman's ρ

### LoRA config
lora_dropout: 0.0

lora_alpha: 16

target_modules: ["query", "key", "value", "intermediate.dense", "output.dense"]

modules_to_save: ["classifier"]

### Training config
class: AdamW

betas: (0.9, 0.98)

weight_decay: 0.01

learning rate: 1e-4

epoch: 50

batch size: 100

precision: 16-mixed