Model save

README.md

@@ -17,8 +17,8 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [facebook/esm2_t33_650M_UR50D](https://huggingface.co/facebook/esm2_t33_650M_UR50D) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 1.2072
-- Spearmanr: 0.6411
+- Loss: 1.1045
+- Spearmanr: 0.6618
 
 ## Model description
 
@@ -44,20 +44,18 @@ The following hyperparameters were used during training:
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: cosine
 - lr_scheduler_warmup_ratio: 0.1
-- num_epochs: 7
+- num_epochs: 5
 - mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Spearmanr |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|
-| 3.3764        | 1.0   | 643  | 1.4308          | 0.6338    |
-| 1.3787        | 2.0   | 1286 | 1.3095          | 0.6546    |
-| 1.2298        | 3.0   | 1929 | 1.1653          | 0.6540    |
-| 1.0901        | 4.0   | 2572 | 1.2472          | 0.6532    |
-| 0.9758        | 5.0   | 3215 | 1.1286          | 0.6615    |
-| 0.874         | 6.0   | 3858 | 1.1729          | 0.6485    |
-| 0.6273        | 7.0   | 4501 | 1.2072          | 0.6411    |
+| 3.0658        | 1.0   | 643  | 1.2677          | 0.6347    |
+| 1.3185        | 2.0   | 1286 | 1.1780          | 0.6502    |
+| 1.1867        | 3.0   | 1929 | 1.1368          | 0.6568    |
+| 1.0087        | 4.0   | 2572 | 1.0889          | 0.6640    |
+| 0.864         | 5.0   | 3215 | 1.1045          | 0.6618    |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:739e712ebc8e86ea425d418508807e7a40f0a26bd8fe388be97d35df56b3bf5a
+oid sha256:6303cd92f95c0a793e7e26421258acada83cfcbd92e580441ee12aabe664ccc8
 size 2609492776