Training in progress, epoch 6

README.md

@@ -14,7 +14,7 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/neuria99/Gemma2%202b%20it%20text2SQL%20Neuria/runs/kxq7m662)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/neuria99/Gemma2%202b%20it%20text2SQL%20Neuria/runs/qd2uve3m)
 # NeurIA_SQL_gemma-2-2b
 
 This model is a fine-tuned version of [google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it) on an unknown dataset.
@@ -43,7 +43,7 @@ The following hyperparameters were used during training:
 - gradient_accumulation_steps: 6
 - total_train_batch_size: 24
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: cosine
+- lr_scheduler_type: polynomial
 - num_epochs: 10
 - mixed_precision_training: Native AMP
 

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:807fa64874a2a4a777a5616917ae1437603443043e0a3ae0b281ec2b2b61507a
+oid sha256:01b587336ecb552d83b600f79df36e093f316970c32894bf2e866ff03d45357b
 size 41581360