agemagician commited on
Commit
52aab73
1 Parent(s): 5160645

Update README.md

Browse files

fix activation function

Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -22,7 +22,9 @@ ANKH2-Large is based on the `ANKH-Large` model and was pretrained on a large cor
22
  This means it was pretrained on the raw protein sequences only, with no humans labelling them in any way (which is why it can use lots of
23
  publicly available data) with an automatic process to generate inputs and labels from those protein sequences.
24
 
25
- One important difference between this ANKH2-Large model and the original ANKH-Large version is that the model was trained with more number of epochs.
 
 
26
 
27
  It has been shown that the features extracted from this self-supervised model (LM-embeddings) captured important biophysical properties governing protein shape.
28
  shape.
 
22
  This means it was pretrained on the raw protein sequences only, with no humans labelling them in any way (which is why it can use lots of
23
  publicly available data) with an automatic process to generate inputs and labels from those protein sequences.
24
 
25
+ Two important differences between this ANKH2-Large model and the original ANKH-Large version are:
26
+ 1. The model was trained with more number of epochs.
27
+ 2. The activation function changed to silu.
28
 
29
  It has been shown that the features extracted from this self-supervised model (LM-embeddings) captured important biophysical properties governing protein shape.
30
  shape.