raj-p commited on
Commit
c43acda
1 Parent(s): 3e0a165

Upload TFBertForSequenceClassification

Browse files
Files changed (3) hide show
  1. README.md +9 -16
  2. config.json +4 -4
  3. tf_model.h5 +1 -1
README.md CHANGED
@@ -3,17 +3,9 @@ license: apache-2.0
3
  base_model: bert-base-uncased
4
  tags:
5
  - generated_from_keras_callback
6
- - really-cool
7
  model-index:
8
  - name: bert-base-uncased-finetuned-glue-sst2
9
  results: []
10
- datasets:
11
- - glue
12
- language:
13
- - en
14
- metrics:
15
- - accuracy
16
- pipeline_tag: text-classification
17
  ---
18
 
19
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
@@ -21,19 +13,21 @@ probably proofread and complete it, then remove this comment. -->
21
 
22
  # bert-base-uncased-finetuned-glue-sst2
23
 
24
- Use for **sentiment analysis**. Labels: `positive`, `negative`
 
25
 
26
- This model is a fine-tuned version of the [bert-base-uncased](https://huggingface.co/bert-base-uncased) model, fine-tuned on a subset of the [glue sst2 dataset](https://huggingface.co/datasets/glue/viewer/sst2). It achieves `91.74%` accuracy on the validation dataset.
27
 
28
  ## Model description
29
 
30
- The `bert-base-uncased` model is a pretrained English language model which has learned a bidirectional representation through Masked Language Modeling (MLM).
31
 
32
- The `bert-base-uncased-finetuned-glue-sst2` adds a 2-class classification head to `bert-base-uncased`. It is then fine-tuned for **sentiment analysis** on the [glue sst2 dataset](https://huggingface.co/datasets/glue/viewer/sst2).
 
 
33
 
34
  ## Training and evaluation data
35
 
36
- This model was only trained on 10000 samples, while the entire glue sst2 training set includes 67349 examples. This was done mainly to decrease training time.
37
 
38
  ## Training procedure
39
 
@@ -45,12 +39,11 @@ The following hyperparameters were used during training:
45
 
46
  ### Training results
47
 
48
- - Accuracy (training): `94.08%`
49
- - Accuracy (validation): `91.74%`
50
 
51
  ### Framework versions
52
 
53
  - Transformers 4.35.2
54
  - TensorFlow 2.15.0
55
  - Datasets 2.16.1
56
- - Tokenizers 0.15.0
 
3
  base_model: bert-base-uncased
4
  tags:
5
  - generated_from_keras_callback
 
6
  model-index:
7
  - name: bert-base-uncased-finetuned-glue-sst2
8
  results: []
 
 
 
 
 
 
 
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information Keras had access to. You should
 
13
 
14
  # bert-base-uncased-finetuned-glue-sst2
15
 
16
+ This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
 
 
19
 
20
  ## Model description
21
 
22
+ More information needed
23
 
24
+ ## Intended uses & limitations
25
+
26
+ More information needed
27
 
28
  ## Training and evaluation data
29
 
30
+ More information needed
31
 
32
  ## Training procedure
33
 
 
39
 
40
  ### Training results
41
 
42
+
 
43
 
44
  ### Framework versions
45
 
46
  - Transformers 4.35.2
47
  - TensorFlow 2.15.0
48
  - Datasets 2.16.1
49
+ - Tokenizers 0.15.0
config.json CHANGED
@@ -10,14 +10,14 @@
10
  "hidden_dropout_prob": 0.1,
11
  "hidden_size": 768,
12
  "id2label": {
13
- "negative": 0,
14
- "positive": 1
15
  },
16
  "initializer_range": 0.02,
17
  "intermediate_size": 3072,
18
  "label2id": {
19
- "0": "negative",
20
- "1": "positive"
21
  },
22
  "layer_norm_eps": 1e-12,
23
  "max_position_embeddings": 512,
 
10
  "hidden_dropout_prob": 0.1,
11
  "hidden_size": 768,
12
  "id2label": {
13
+ "0": "negative",
14
+ "1": "positive"
15
  },
16
  "initializer_range": 0.02,
17
  "intermediate_size": 3072,
18
  "label2id": {
19
+ "negative": 0,
20
+ "positive": 1
21
  },
22
  "layer_norm_eps": 1e-12,
23
  "max_position_embeddings": 512,
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a30c9dd440db01dc056bb5a7e68c619a17ad10082d1e0de294d1bb53cf227f0f
3
  size 438223128
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6aba084d763a2ae05810d8bcca305dce000e670ffee5f1dbfba402bf2efa4fa7
3
  size 438223128