Model save

README.md

@@ -14,7 +14,7 @@ model-index:
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/neuria99/Gemma2%202b%20it%20text2SQL%20Neuria/runs/r9i6m450)
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/neuria99/Gemma2%202b%20it%20text2SQL%20Neuria/runs/0rqvpvpc)
 # NeurIA_SQL_gemma-2-2b
 
 This model is a fine-tuned version of [google/gemma-2-2b-it](https://huggingface.co/google/gemma-2-2b-it) on an unknown dataset.
@@ -37,14 +37,14 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 0.0001
-- train_batch_size: 10
+- train_batch_size: 2
 - eval_batch_size: 8
 - seed: 42
-- gradient_accumulation_steps: 10
-- total_train_batch_size: 100
+- gradient_accumulation_steps: 4
+- total_train_batch_size: 8
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: polynomial
-- num_epochs: 20
+- lr_scheduler_type: linear
+- num_epochs: 30
 
 ### Framework versions
 

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:157e384e6263bb75ebf65d8365f2cfed4291d1da553c5029ad0d426256db1fe3
+oid sha256:2649baef31dfac0800b8dc2ba065819578f6ce4065a06e7bdeb95eacfc669156
 size 20814440