Model save

README.md

@@ -9,10 +9,6 @@ base_model: tiiuae/falcon-7b
 model-index:
 - name: falcon7b-linear-equations
   results: []
-datasets:
-- Menouar/LinearEquations
-language:
-- en
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -20,15 +16,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 # falcon7b-linear-equations
 
-This model is a fine-tuned version of [tiiuae/falcon-7b](https://huggingface.co/tiiuae/falcon-7b) on [Linear Equations Dataset](https://huggingface.co/datasets/Menouar/LinearEquations).
+This model is a fine-tuned version of [tiiuae/falcon-7b](https://huggingface.co/tiiuae/falcon-7b) on an unknown dataset.
 
 ## Model description
 
-The objective of this work is to fine-tune the [tiiuae/falcon-7b](https://huggingface.co/tiiuae/falcon-7b) on curated dataset of linear equations. 
-The aim is to enhance the model’s ability to solve mathematical linear equations in the form of:
-```
-ay + b = dy + c.
-```
+More information needed
 
 ## Intended uses & limitations
 
@@ -44,23 +36,23 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 0.0002
-- train_batch_size: 40
+- train_batch_size: 42
 - eval_batch_size: 8
 - seed: 42
 - gradient_accumulation_steps: 2
-- total_train_batch_size: 80
+- total_train_batch_size: 84
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: constant
 - lr_scheduler_warmup_ratio: 0.03
-- training_steps: 1600
+- training_steps: 600
 
 ### Training results
 
-[Training Results on TensorBoard](https://huggingface.co/Menouar/falcon7b-linear-equations/tensorboard)
+
 
 ### Framework versions
 
-- PEFT 0.7.2.dev0
+- PEFT 0.8.1.dev0
 - Transformers 4.38.0.dev0
 - Pytorch 2.1.0+cu121
 - Datasets 2.16.1