A fine-tuned model based on the **DeBERTaV3** model of Microsoft and fine-tuned on **Glue QQP**, which detects the linguistical similarities between two questions and whether they are similar questions or dissimilar. ## Model Hyperparameters ```python epoch=4 per_device_train_batch_size=32 per_device_eval_batch_size=16 lr=2e-5 weight_decay=1e-2 gradient_checkpointing=True gradient_accumulation_steps=8 ``` ## Model Performance ```JSON {"Training Loss": 0.132400, "Validation Loss": 0.217410, "Validation Accuracy": 0.917969 } ``` ## Model Dependencies ```JSON {"Main Model": "microsoft/deberta-v3-base", "Dataset": "SetFit/qqp" } ```