dreemer6 commited on
Commit
84113b4
1 Parent(s): b30d405

Training in progress epoch 0

Browse files
Files changed (3) hide show
  1. README.md +12 -5
  2. config.json +1 -9
  3. tf_model.h5 +1 -1
README.md CHANGED
@@ -3,18 +3,22 @@ license: apache-2.0
3
  tags:
4
  - generated_from_keras_callback
5
  model-index:
6
- - name: bert-finetuned-sst2
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
11
  probably proofread and complete it, then remove this comment. -->
12
 
13
- # bert-finetuned-sst2
14
 
15
- This model is a fine-tuned version of [dreemer6/bert-finetuned-sst2](https://huggingface.co/dreemer6/bert-finetuned-sst2) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
-
 
 
 
 
18
 
19
  ## Model description
20
 
@@ -33,11 +37,14 @@ More information needed
33
  ### Training hyperparameters
34
 
35
  The following hyperparameters were used during training:
36
- - optimizer: None
37
  - training_precision: float32
38
 
39
  ### Training results
40
 
 
 
 
41
 
42
 
43
  ### Framework versions
 
3
  tags:
4
  - generated_from_keras_callback
5
  model-index:
6
+ - name: dreemer6/bert-finetuned-sst2
7
  results: []
8
  ---
9
 
10
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
11
  probably proofread and complete it, then remove this comment. -->
12
 
13
+ # dreemer6/bert-finetuned-sst2
14
 
15
+ This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Train Loss: 0.2323
18
+ - Train Accuracy: 0.9097
19
+ - Validation Loss: 0.3061
20
+ - Validation Accuracy: 0.9048
21
+ - Epoch: 0
22
 
23
  ## Model description
24
 
 
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
40
+ - optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 5e-05, 'decay_steps': 126285, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
41
  - training_precision: float32
42
 
43
  ### Training results
44
 
45
+ | Train Loss | Train Accuracy | Validation Loss | Validation Accuracy | Epoch |
46
+ |:----------:|:--------------:|:---------------:|:-------------------:|:-----:|
47
+ | 0.2323 | 0.9097 | 0.3061 | 0.9048 | 0 |
48
 
49
 
50
  ### Framework versions
config.json CHANGED
@@ -1,5 +1,5 @@
1
  {
2
- "_name_or_path": "dreemer6/bert-finetuned-sst2",
3
  "architectures": [
4
  "BertForSequenceClassification"
5
  ],
@@ -9,16 +9,8 @@
9
  "hidden_act": "gelu",
10
  "hidden_dropout_prob": 0.1,
11
  "hidden_size": 768,
12
- "id2label": {
13
- "0": "negative",
14
- "1": "positive"
15
- },
16
  "initializer_range": 0.02,
17
  "intermediate_size": 3072,
18
- "label2id": {
19
- "negative": "0",
20
- "positive": "1"
21
- },
22
  "layer_norm_eps": 1e-12,
23
  "max_position_embeddings": 512,
24
  "model_type": "bert",
 
1
  {
2
+ "_name_or_path": "bert-base-uncased",
3
  "architectures": [
4
  "BertForSequenceClassification"
5
  ],
 
9
  "hidden_act": "gelu",
10
  "hidden_dropout_prob": 0.1,
11
  "hidden_size": 768,
 
 
 
 
12
  "initializer_range": 0.02,
13
  "intermediate_size": 3072,
 
 
 
 
14
  "layer_norm_eps": 1e-12,
15
  "max_position_embeddings": 512,
16
  "model_type": "bert",
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:38a28f8d261702bc5209c8d72ccc457da257ced46fa3dc3d265b861ee4529c7c
3
  size 438223192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ea3d19c35228840ca235f05cffc51341a4632a36fda3559aabdd9c8dd85843b
3
  size 438223192