nakcnx commited on
Commit
0726965
·
1 Parent(s): a30cbc7

Create README.txt

Browse files
Files changed (1) hide show
  1. README.txt +65 -0
README.txt ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - th
5
+ pipeline_tag: text-generation
6
+ tags:
7
+ - TGPT
8
+ library_name: transformers
9
+ datasets:
10
+ - th_wikipedia
11
+ model-index:
12
+ - name: TGPT-2-345M
13
+ results: []
14
+ widget:
15
+ - text: "ประเทศไทยเป็นประเทศที่"
16
+ - text: "กรุงเทพเคยเกิด"
17
+ - text: "ระบบสุริยะจักรวาลเป็น"
18
+ ---
19
+
20
+ <!-- This model card has been generated automatically according to the information Keras had access to. You should
21
+ probably proofread and complete it, then remove this comment. -->
22
+
23
+ # TGPT-2-345M
24
+
25
+ This model is a fine-tuned version of [](https://huggingface.co/) on an th_wikipedia dataset.
26
+ It achieves the following results on the evaluation set:
27
+ - Train Loss: 3.5955
28
+ - Train Accuracy: 0.4289
29
+ - Epoch: 1
30
+
31
+ ## Model description
32
+
33
+ GPT-2
34
+
35
+ ## Intended uses & limitations
36
+
37
+ -
38
+
39
+ ## Training and evaluation data
40
+
41
+ -
42
+
43
+ ## Training procedure
44
+
45
+ -
46
+
47
+ ### Training hyperparameters
48
+
49
+ The following hyperparameters were used during training:
50
+ - optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': 1.0, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': 3e-05, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
51
+ - training_precision: float32
52
+
53
+ ### Training results
54
+
55
+ | Train Loss | Train Accuracy | Epoch |
56
+ |:----------:|:--------------:|:-----:|
57
+ | 3.5955 | 0.4289 | 1 |
58
+
59
+
60
+ ### Framework versions
61
+
62
+ - Transformers 4.26.0
63
+ - TensorFlow 2.11.0
64
+ - Datasets 2.10.0
65
+ - Tokenizers 0.13.2