pedro-silva-first-model

README.md

@@ -0,0 +1,55 @@
+---
+license: apache-2.0
+base_model: distilbert-base-uncased
+tags:
+- generated_from_trainer
+model-index:
+- name: results
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# results
+
+This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 32
+- eval_batch_size: 32
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 1
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Accuracy |
+|:-------------:|:-----:|:----:|:---------------:|:--------:|
+| No log        | 1.0   | 32   | 0.6623          | 0.7      |
+
+
+### Framework versions
+
+- Transformers 4.41.1
+- Pytorch 2.3.0+cu121
+- Datasets 2.19.1
+- Tokenizers 0.19.1

config.json

@@ -0,0 +1,25 @@
+{
+  "_name_or_path": "distilbert-base-uncased",
+  "activation": "gelu",
+  "architectures": [
+    "DistilBertForSequenceClassification"
+  ],
+  "attention_dropout": 0.1,
+  "dim": 768,
+  "dropout": 0.1,
+  "hidden_dim": 3072,
+  "initializer_range": 0.02,
+  "max_position_embeddings": 512,
+  "model_type": "distilbert",
+  "n_heads": 12,
+  "n_layers": 6,
+  "pad_token_id": 0,
+  "problem_type": "single_label_classification",
+  "qa_dropout": 0.1,
+  "seq_classif_dropout": 0.2,
+  "sinusoidal_pos_embds": false,
+  "tie_weights_": true,
+  "torch_dtype": "float32",
+  "transformers_version": "4.41.1",
+  "vocab_size": 30522
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:312631892df8cf551e65d4990d6a035e7895532ad7f39ae981b95841ccbe5b3d
+size 267832560

runs/May24_12-21-42_37d912e4bf4b/events.out.tfevents.1716553304.37d912e4bf4b.1888.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72d840536800e261692ca43e180ace3bab2c98fc71332d9e2369f8ab0b7f902c
+size 4992

runs/May24_12-50-38_37d912e4bf4b/events.out.tfevents.1716555039.37d912e4bf4b.9237.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:12dc045c8bdbc703530dbe5c47618d33a4e5bc74e834800d52d7df72b6cc1112
+size 4781

runs/May24_13-01-31_37d912e4bf4b/events.out.tfevents.1716555691.37d912e4bf4b.9237.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a53ddd9caba76eb7e480a73074d9479a69c1c235ea9199d0e60caced6969a0c8
+size 5334

runs/May24_13-13-35_37d912e4bf4b/events.out.tfevents.1716556416.37d912e4bf4b.9237.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:df6b53e28ca02536206b916d79ad1672ed49a6c3ba1293fc5ea4f5e6bea12ded
+size 5333

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1bf4eb23ae4b7a952e0fff97d26f40850e1f2efe3931cf740c10fc71189559f6
+size 5112