Training in progress, epoch 1

README.md

@@ -0,0 +1,59 @@
+---
+license: apache-2.0
+library_name: peft
+tags:
+- trl
+- sft
+- generated_from_trainer
+base_model: mistralai/Mistral-7B-Instruct-v0.2
+model-index:
+- name: mistral_counter
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# mistral_counter
+
+This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on the None dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0002
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 5
+- total_train_batch_size: 40
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: cosine
+- training_steps: 500
+- mixed_precision_training: Native AMP
+
+### Training results
+
+
+
+### Framework versions
+
+- PEFT 0.11.1
+- Transformers 4.40.2
+- Pytorch 2.1.0a0+29c30b1
+- Datasets 2.19.1
+- Tokenizers 0.19.1

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:188ec5108591311aba3810d058753360e244d3e832a1e2dcd8177a0599a4bf46
+oid sha256:3724dd0e48aa6781bfdbb8b5ad38412eb01fa2db78dde05b53b3fb1af9aa5b14
 size 27280152

runs/Jun03_10-40-47_5fa797f4384f/events.out.tfevents.1717411248.5fa797f4384f.434.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db5c31899ceb8423212297e1227a5a68dadbf73dfaad0f5d5c2e1cd703a91a00
+size 5332

runs/May21_10-02-08_0849e2ce08a2/events.out.tfevents.1716285729.0849e2ce08a2.436.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:991f1e24a0c226e35e895125b7a4ed904c63a21100c8f2668cd976977be24c64
-size 6033
+oid sha256:62916c5949c98290c1897d4f7802e601e2ac34b16788a63e07ad233a18299f9c
+size 7653

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6c9b65c8df7aea798ecd4a2279b4c662a549ab4343ee6db11dba811e6f0dbe08
-size 5048
+oid sha256:cf3cb91fa2ef119af38ca3e0f7e50024434657634d625af22b58696fa5083472
+size 5176