rnaveensrinivas commited on
Commit
0c12fda
·
verified ·
1 Parent(s): 194e0cd

End of training

Browse files
README.md CHANGED
@@ -15,6 +15,8 @@ should probably proofread and complete it, then remove this comment. -->
15
  # falcon-rw-1b-instruct-openorca-retrained_network_corpus
16
 
17
  This model is a fine-tuned version of [ericzzz/falcon-rw-1b-instruct-openorca](https://huggingface.co/ericzzz/falcon-rw-1b-instruct-openorca) on an unknown dataset.
 
 
18
 
19
  ## Model description
20
 
@@ -45,6 +47,18 @@ The following hyperparameters were used during training:
45
  - num_epochs: 10
46
  - mixed_precision_training: Native AMP
47
 
 
 
 
 
 
 
 
 
 
 
 
 
48
  ### Framework versions
49
 
50
  - PEFT 0.11.1
 
15
  # falcon-rw-1b-instruct-openorca-retrained_network_corpus
16
 
17
  This model is a fine-tuned version of [ericzzz/falcon-rw-1b-instruct-openorca](https://huggingface.co/ericzzz/falcon-rw-1b-instruct-openorca) on an unknown dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 1.5152
20
 
21
  ## Model description
22
 
 
47
  - num_epochs: 10
48
  - mixed_precision_training: Native AMP
49
 
50
+ ### Training results
51
+
52
+ | Training Loss | Epoch | Step | Validation Loss |
53
+ |:-------------:|:------:|:----:|:---------------:|
54
+ | 3.7165 | 0.5714 | 1 | 2.1857 |
55
+ | 1.7689 | 1.7143 | 3 | 1.9718 |
56
+ | 1.588 | 2.8571 | 5 | 1.7478 |
57
+ | 1.4636 | 4.0 | 7 | 1.6172 |
58
+ | 2.7378 | 4.5714 | 8 | 1.5710 |
59
+ | 0.9276 | 5.7143 | 10 | 1.5152 |
60
+
61
+
62
  ### Framework versions
63
 
64
  - PEFT 0.11.1
runs/Jun20_10-04-42_bef7a67c3ba5/events.out.tfevents.1718877941.bef7a67c3ba5.34.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:06956c3e6663ae9db8c92c73e4bdfc9c6f10782e343c12ebc5010b6143da813c
3
+ size 354