End of training

README.md

@@ -0,0 +1,72 @@
+---
+library_name: transformers
+license: apache-2.0
+base_model: bert-base-uncased
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+model-index:
+- name: bert-base-uncased-grammar-ner
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# bert-base-uncased-grammar-ner
+
+This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.1112
+- Accuracy: 0.9887
+- F1 Macro: 0.7886
+- F1 Micro: 0.9888
+- Precision Macro: 0.8418
+- Precision Micro: 0.9887
+- Recall Macro: 0.7568
+- Recall Micro: 0.9889
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 24
+- eval_batch_size: 24
+- seed: 42
+- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
+- lr_scheduler_type: linear
+- num_epochs: 6
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 Macro | F1 Micro | Precision Macro | Precision Micro | Recall Macro | Recall Micro |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|:--------:|:---------------:|:---------------:|:------------:|:------------:|
+| 0.0388        | 1.0   | 93   | 0.1275          | 0.9813   | 0.6122   | 0.9816   | 0.7265          | 0.9816          | 0.5596       | 0.9816       |
+| 0.0227        | 2.0   | 186  | 0.1113          | 0.9853   | 0.6907   | 0.9854   | 0.7169          | 0.9853          | 0.6795       | 0.9855       |
+| 0.0085        | 3.0   | 279  | 0.1155          | 0.9868   | 0.7550   | 0.9868   | 0.8260          | 0.9868          | 0.7155       | 0.9869       |
+| 0.0045        | 4.0   | 372  | 0.1146          | 0.9866   | 0.7407   | 0.9867   | 0.7604          | 0.9866          | 0.7299       | 0.9868       |
+| 0.0027        | 5.0   | 465  | 0.1084          | 0.9890   | 0.7935   | 0.9891   | 0.8525          | 0.9890          | 0.7570       | 0.9892       |
+| 0.0008        | 6.0   | 558  | 0.1112          | 0.9887   | 0.7886   | 0.9888   | 0.8418          | 0.9887          | 0.7568       | 0.9889       |
+
+
+### Framework versions
+
+- Transformers 4.46.3
+- Pytorch 2.5.1+cu121
+- Datasets 3.2.0
+- Tokenizers 0.20.3

config.json

@@ -0,0 +1,130 @@
+{
+  "_name_or_path": "bert-base-uncased",
+  "architectures": [
+    "BertForTokenClassification"
+  ],
+  "attention_probs_dropout_prob": 0.1,
+  "classifier_dropout": null,
+  "gradient_checkpointing": false,
+  "hidden_act": "gelu",
+  "hidden_dropout_prob": 0.1,
+  "hidden_size": 768,
+  "id2label": {
+    "0": "B-U:PREP",
+    "1": "I-U:VERB:TENSE",
+    "2": "I-R:NOUN:INFL",
+    "3": "I-R:VERB:TENSE",
+    "4": "I-R:WO",
+    "5": "I-U:OTHER",
+    "6": "B-U:VERB",
+    "7": "B-R:VERB:INFL",
+    "8": "I-R:VERB:INFL",
+    "9": "B-R:VERB:SVA",
+    "10": "B-U:NOUN",
+    "11": "B-R:PREP",
+    "12": "I-U:NOUN",
+    "13": "B-U:CONJ",
+    "14": "I-R:PUNCT",
+    "15": "B-R:SPELL",
+    "16": "B-U:PRON",
+    "17": "I-R:SPELL",
+    "18": "B-R:WO",
+    "19": "I-R:MORPH",
+    "20": "B-R:VERB:TENSE",
+    "21": "B-R:NOUN",
+    "22": "I-R:OTHER",
+    "23": "B-U:DET",
+    "24": "B-U:PART",
+    "25": "B-R:ADV",
+    "26": "I-R:VERB:SVA",
+    "27": "I-R:DET",
+    "28": "B-R:NOUN:NUM",
+    "29": "O",
+    "30": "B-R:ADJ",
+    "31": "B-U:VERB:TENSE",
+    "32": "B-R:PRON",
+    "33": "I-U:VERB",
+    "34": "I-R:ADV",
+    "35": "I-R:VERB:FORM",
+    "36": "B-R:OTHER",
+    "37": "B-U:VERB:FORM",
+    "38": "B-U:ADV",
+    "39": "B-R:NOUN:INFL",
+    "40": "B-R:PART",
+    "41": "B-U:OTHER",
+    "42": "I-R:VERB",
+    "43": "B-R:PUNCT",
+    "44": "B-R:VERB",
+    "45": "B-R:DET",
+    "46": "B-R:MORPH",
+    "47": "I-R:NOUN",
+    "48": "B-R:VERB:FORM",
+    "49": "B-R:ADJ:FORM"
+  },
+  "initializer_range": 0.02,
+  "intermediate_size": 3072,
+  "label2id": {
+    "B-R:ADJ": 30,
+    "B-R:ADJ:FORM": 49,
+    "B-R:ADV": 25,
+    "B-R:DET": 45,
+    "B-R:MORPH": 46,
+    "B-R:NOUN": 21,
+    "B-R:NOUN:INFL": 39,
+    "B-R:NOUN:NUM": 28,
+    "B-R:OTHER": 36,
+    "B-R:PART": 40,
+    "B-R:PREP": 11,
+    "B-R:PRON": 32,
+    "B-R:PUNCT": 43,
+    "B-R:SPELL": 15,
+    "B-R:VERB": 44,
+    "B-R:VERB:FORM": 48,
+    "B-R:VERB:INFL": 7,
+    "B-R:VERB:SVA": 9,
+    "B-R:VERB:TENSE": 20,
+    "B-R:WO": 18,
+    "B-U:ADV": 38,
+    "B-U:CONJ": 13,
+    "B-U:DET": 23,
+    "B-U:NOUN": 10,
+    "B-U:OTHER": 41,
+    "B-U:PART": 24,
+    "B-U:PREP": 0,
+    "B-U:PRON": 16,
+    "B-U:VERB": 6,
+    "B-U:VERB:FORM": 37,
+    "B-U:VERB:TENSE": 31,
+    "I-R:ADV": 34,
+    "I-R:DET": 27,
+    "I-R:MORPH": 19,
+    "I-R:NOUN": 47,
+    "I-R:NOUN:INFL": 2,
+    "I-R:OTHER": 22,
+    "I-R:PUNCT": 14,
+    "I-R:SPELL": 17,
+    "I-R:VERB": 42,
+    "I-R:VERB:FORM": 35,
+    "I-R:VERB:INFL": 8,
+    "I-R:VERB:SVA": 26,
+    "I-R:VERB:TENSE": 3,
+    "I-R:WO": 4,
+    "I-U:NOUN": 12,
+    "I-U:OTHER": 5,
+    "I-U:VERB": 33,
+    "I-U:VERB:TENSE": 1,
+    "O": 29
+  },
+  "layer_norm_eps": 1e-12,
+  "max_position_embeddings": 512,
+  "model_type": "bert",
+  "num_attention_heads": 12,
+  "num_hidden_layers": 12,
+  "pad_token_id": 0,
+  "position_embedding_type": "absolute",
+  "torch_dtype": "float32",
+  "transformers_version": "4.46.3",
+  "type_vocab_size": 2,
+  "use_cache": true,
+  "vocab_size": 30522
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:898ad17c5286bdcb31b773b2aaaa66a85e4495c16dcd5f78404e3a492b04d3d9
+size 435743736

runs/Dec12_22-37-18_a365e7b9463b/events.out.tfevents.1734043038.a365e7b9463b.6288.7

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3ebdf7a8c90a52e4dcea979be104c207bd7f21d36fc49f26a71b1d0f80ba4b0
+size 18100

runs/Dec12_22-38-28_a365e7b9463b/events.out.tfevents.1734043108.a365e7b9463b.6288.8

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:86c348ccf5dbe4e7a2a027e222a0b98293e4a8a71f7b4e2083d79aa3969eaecc
+size 12890

special_tokens_map.json

@@ -0,0 +1,7 @@
+{
+  "cls_token": "[CLS]",
+  "mask_token": "[MASK]",
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "unk_token": "[UNK]"
+}

tokenizer_config.json

@@ -0,0 +1,55 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "100": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "101": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "102": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "103": {
+      "content": "[MASK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "clean_up_tokenization_spaces": false,
+  "cls_token": "[CLS]",
+  "do_lower_case": true,
+  "mask_token": "[MASK]",
+  "model_max_length": 512,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "strip_accents": null,
+  "tokenize_chinese_chars": true,
+  "tokenizer_class": "BertTokenizer",
+  "unk_token": "[UNK]"
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fba559b60c5d760413ca4c35858fba48e69260c499152a0432bcbe8cfdd2f1d6
+size 5304