End of training

README.md

@@ -0,0 +1,69 @@
+---
+language:
+- en
+license: mit
+base_model: prajjwal1/bert-tiny
+tags:
+- pytorch
+- BertForTokenClassification
+- bert-tiny
+- nammed-entity-recogntion
+- generated_from_trainer
+model-index:
+- name: bert-tiny-privacy
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# bert-tiny-privacy
+
+This model is a fine-tuned version of [prajjwal1/bert-tiny](https://huggingface.co/prajjwal1/bert-tiny) on the beki/privy dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.0235
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 4e-05
+- train_batch_size: 32
+- eval_batch_size: 128
+- seed: 13434865
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: cosine
+- lr_scheduler_warmup_ratio: 0.01
+- training_steps: 15000
+
+### Training results
+
+| Training Loss | Epoch | Step  | Validation Loss |
+|:-------------:|:-----:|:-----:|:---------------:|
+| 0.1891        | 0.19  | 2500  | 0.1369          |
+| 0.0869        | 0.38  | 5000  | 0.0503          |
+| 0.0609        | 0.57  | 7500  | 0.0314          |
+| 0.0512        | 0.76  | 10000 | 0.0259          |
+| 0.0493        | 0.95  | 12500 | 0.0240          |
+| 0.048         | 1.14  | 15000 | 0.0237          |
+
+
+### Framework versions
+
+- Transformers 4.36.2
+- Pytorch 2.1.0+cu121
+- Datasets 2.16.0
+- Tokenizers 0.15.0

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b5b4b462ab7a80ef05de66a56776a8e9eada14fadb46a2f366be8da56520344d
+oid sha256:88cf99905279acc6cdc65716cafb97a2d35a2b761132a78a78c94646e40726e7
 size 17542420

runs/Dec23_04-07-26_cf6a4d141451/events.out.tfevents.1703304455.cf6a4d141451.215.2

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0c0dacaaa53870987d5300f2e0db8c9447b785afdb8a906595f3afd2a9053374
-size 26742
+oid sha256:8afa8a5477a01c2ca9a629368752a88458dc445079b8f4b9c157af7442adfdd1
+size 35488

runs/Dec23_04-07-26_cf6a4d141451/events.out.tfevents.1703305264.cf6a4d141451.215.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:30c0bb0e91d012861e5e849de76dcea6db5c8d1806b4dfbb3db4c3a1c4f5fd25
+size 359