End of training

README.md

@@ -4,6 +4,10 @@ library_name: peft
 tags:
 - generated_from_trainer
 base_model: facebook/esm2_t6_8M_UR50D
+metrics:
+- precision
+- recall
+- accuracy
 model-index:
 - name: esm2-t6-8M-lora-256-remote-homology-filtered
   results: []
@@ -15,6 +19,12 @@ should probably proofread and complete it, then remove this comment. -->
 # esm2-t6-8M-lora-256-remote-homology-filtered
 
 This model is a fine-tuned version of [facebook/esm2_t6_8M_UR50D](https://huggingface.co/facebook/esm2_t6_8M_UR50D) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.5982
+- Precision: 0.6901
+- Recall: 0.6529
+- F1-score: 0.6709
+- Accuracy: 0.6788
 
 ## Model description
 
@@ -43,6 +53,17 @@ The following hyperparameters were used during training:
 - num_epochs: 5
 - mixed_precision_training: Native AMP
 
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss | Precision | Recall | F1-score | Accuracy |
+|:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:--------:|:--------:|
+| 0.6365        | 1.0   | 7969  | 0.6357          | 0.6218    | 0.7071 | 0.6617   | 0.6374   |
+| 0.6046        | 2.0   | 15938 | 0.6102          | 0.6864    | 0.6149 | 0.6487   | 0.6660   |
+| 0.6134        | 3.0   | 23907 | 0.6017          | 0.6887    | 0.6469 | 0.6672   | 0.6763   |
+| 0.6108        | 4.0   | 31876 | 0.5986          | 0.6920    | 0.6468 | 0.6687   | 0.6785   |
+| 0.5831        | 5.0   | 39845 | 0.5982          | 0.6901    | 0.6529 | 0.6709   | 0.6788   |
+
+
 ### Framework versions
 
 - PEFT 0.11.1

adapter_config.json

@@ -24,8 +24,8 @@
   "revision": null,
   "target_modules": [
     "query",
-    "value",
-    "key"
+    "key",
+    "value"
   ],
   "task_type": "SEQ_CLS",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1ff88b48449e6c5759b5a901fd9f1c114d14f6cd8e6a2f6164ae7b292db79af7
+oid sha256:7c1c497ae8d47ec47501fac643e4dbac4a8dfd93f6ff7ea62c92bc02f4ebf5f7
 size 12310716

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ee2ab443e06df894a8410ffd9457d036cdcbe1f58056a7caece6ae3173f9082f
+oid sha256:dd4362dcc9cdb1d29c88d77a487f56e575ce691667329f1ab3ae5a802603c87b
 size 4984