LovenOO commited on
Commit
032f112
1 Parent(s): 3a74765

Training in progress epoch 0

Browse files
Files changed (3) hide show
  1. README.md +9 -14
  2. config.json +16 -40
  3. tf_model.h5 +2 -2
README.md CHANGED
@@ -14,13 +14,13 @@ probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Train Loss: 0.2344
18
- - Validation Loss: 0.5477
19
- - Train Precision: 0.5943
20
- - Train Recall: 0.6009
21
- - Train F1: 0.5963
22
- - Train Accuracy: 0.8552
23
- - Epoch: 5
24
 
25
  ## Model description
26
 
@@ -39,19 +39,14 @@ More information needed
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
- - optimizer: {'name': 'Adam', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 2570, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
43
  - training_precision: float32
44
 
45
  ### Training results
46
 
47
  | Train Loss | Validation Loss | Train Precision | Train Recall | Train F1 | Train Accuracy | Epoch |
48
  |:----------:|:---------------:|:---------------:|:------------:|:--------:|:--------------:|:-----:|
49
- | 1.3362 | 0.6817 | 0.5323 | 0.4961 | 0.5062 | 0.8285 | 0 |
50
- | 0.5545 | 0.5812 | 0.6124 | 0.5624 | 0.5743 | 0.8489 | 1 |
51
- | 0.3958 | 0.5655 | 0.6173 | 0.5757 | 0.5845 | 0.8503 | 2 |
52
- | 0.3047 | 0.5495 | 0.6099 | 0.5855 | 0.5937 | 0.8523 | 3 |
53
- | 0.2500 | 0.5477 | 0.5943 | 0.6009 | 0.5963 | 0.8552 | 4 |
54
- | 0.2344 | 0.5477 | 0.5943 | 0.6009 | 0.5963 | 0.8552 | 5 |
55
 
56
 
57
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Train Loss: 0.8177
18
+ - Validation Loss: 0.4723
19
+ - Train Precision: 0.8407
20
+ - Train Recall: 0.7879
21
+ - Train F1: 0.7948
22
+ - Train Accuracy: 0.8575
23
+ - Epoch: 0
24
 
25
  ## Model description
26
 
 
39
  ### Training hyperparameters
40
 
41
  The following hyperparameters were used during training:
42
+ - optimizer: {'name': 'Adam', 'learning_rate': {'module': 'keras.optimizers.schedules', 'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 2565, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'registered_name': None}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
43
  - training_precision: float32
44
 
45
  ### Training results
46
 
47
  | Train Loss | Validation Loss | Train Precision | Train Recall | Train F1 | Train Accuracy | Epoch |
48
  |:----------:|:---------------:|:---------------:|:------------:|:--------:|:--------------:|:-----:|
49
+ | 0.8177 | 0.4723 | 0.8407 | 0.7879 | 0.7948 | 0.8575 | 0 |
 
 
 
 
 
50
 
51
 
52
  ### Framework versions
config.json CHANGED
@@ -9,49 +9,25 @@
9
  "dropout": 0.1,
10
  "hidden_dim": 3072,
11
  "id2label": {
12
- "0": "Population and Society",
13
- "1": "Children Education and Skills",
14
- "2": "Gaps",
15
- "3": "Covid",
16
- "4": "Crime and Security",
17
- "5": "Climate change",
18
- "6": "Transport",
19
- "7": "Economy",
20
- "8": "Poverty",
21
- "9": "Children Education and Skills (Post-16)",
22
- "10": "Environment",
23
- "11": "census_accounts",
24
- "12": "Health and Social Care",
25
- "13": "Housing Planning and Local Services",
26
- "14": "Statistical Literacy",
27
- "15": "accounts",
28
- "16": "Children",
29
- "17": "NI Health",
30
- "18": "Ukraine",
31
- "19": "Labour Market and Welfare"
32
  },
33
  "initializer_range": 0.02,
34
  "label2id": {
35
- "Children": 16,
36
- "Children Education and Skills": 1,
37
- "Children Education and Skills (Post-16)": 9,
38
- "Climate change": 5,
39
- "Covid": 3,
40
- "Crime and Security": 4,
41
- "Economy": 7,
42
- "Environment": 10,
43
- "Gaps": 2,
44
- "Health and Social Care": 12,
45
- "Housing Planning and Local Services": 13,
46
- "Labour Market and Welfare": 19,
47
- "NI Health": 17,
48
- "Population and Society": 0,
49
- "Poverty": 8,
50
- "Statistical Literacy": 14,
51
- "Transport": 6,
52
- "Ukraine": 18,
53
- "accounts": 15,
54
- "census_accounts": 11
55
  },
56
  "max_position_embeddings": 512,
57
  "model_type": "distilbert",
 
9
  "dropout": 0.1,
10
  "hidden_dim": 3072,
11
  "id2label": {
12
+ "0": "Children, Education and Skills",
13
+ "1": "Health and Social Care",
14
+ "2": "Crime and Security",
15
+ "3": "Economy",
16
+ "4": "Housing, Planning and Local Services",
17
+ "5": "Labour Market and Welfare",
18
+ "6": "Population and Society",
19
+ "7": "Transport, Environment and Climate Change"
 
 
 
 
 
 
 
 
 
 
 
 
20
  },
21
  "initializer_range": 0.02,
22
  "label2id": {
23
+ "Children, Education and Skills": 0,
24
+ "Crime and Security": 2,
25
+ "Economy": 3,
26
+ "Health and Social Care": 1,
27
+ "Housing, Planning and Local Services": 4,
28
+ "Labour Market and Welfare": 5,
29
+ "Population and Society": 6,
30
+ "Transport, Environment and Climate Change": 7
 
 
 
 
 
 
 
 
 
 
 
 
31
  },
32
  "max_position_embeddings": 512,
33
  "model_type": "distilbert",
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a9a60337c0d856ca0c730497e4c880d04749af8ce6a565b4ee063a9050d91449
3
- size 268010440
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:abe43bd49798044e1d0ccf28abbfc963ed6867112ce0d72cc4872a641c95983c
3
+ size 267970240