edmundmills commited on
Commit
cbc33f8
1 Parent(s): d3f5e5c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -10
README.md CHANGED
@@ -11,7 +11,7 @@ should probably proofread and complete it, then remove this comment. -->
11
 
12
  # experience-model-v1
13
 
14
- This model was trained from scratch on an unknown dataset.
15
 
16
  ## Model description
17
 
@@ -23,20 +23,19 @@ More information needed
23
 
24
  ## Training and evaluation data
25
 
26
- More information needed
27
 
28
  ## Training procedure
29
 
 
 
30
  ### Training hyperparameters
31
 
32
- The following hyperparameters were used during training:
33
- - learning_rate: 5e-05
34
- - train_batch_size: 8
35
- - eval_batch_size: 8
36
- - seed: 42
37
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
38
- - lr_scheduler_type: linear
39
- - num_epochs: 3.0
40
 
41
  ### Framework versions
42
 
 
11
 
12
  # experience-model-v1
13
 
14
+ This model is intended to detect the presence of a present-moment experience a human or animal is experiencing in a sentence.
15
 
16
  ## Model description
17
 
 
23
 
24
  ## Training and evaluation data
25
 
26
+ This model was trained on 745 training samples, with ~10% of them containing present moment experiences.
27
 
28
  ## Training procedure
29
 
30
+ This model was fine-tuned from 'microsoft/deberta-v3-large' using https://github.com/AlignmentResearch/experience-model.
31
+
32
  ### Training hyperparameters
33
 
34
+ It used the following hyperparameters:
35
+ learning_rate: 2.0 e-05
36
+ batch_size: 16
37
+ epochs: 200
38
+ weight_decay: 0.01
 
 
 
39
 
40
  ### Framework versions
41