v1

README.md

@@ -84,3 +84,15 @@ Check the [utils/dataset_gen.py](utils/dataset_gen.py) file for the dataset gene
 
 Check the [utils/t5_train_model.py](utils/t5_train_model.py) file for the training process
 
+### Model and Tokenizer versions
+
+Model and Tokenizer V1: trained with 1000 rows 
+commit: v1
+
+Model and Tokenizer V2: trained with 3000 rows
+-> question_generator/model/v2
+-> question_generator/tokenizer/v2
+
+Model and Tokenizer V3: trained with all rows from datasets (78664 rows-train, 9652 rows-validation)
+-> question_generator/model/v3
+-> question_generator/tokenizer/v3