File size: 1,042 Bytes
13ad85c 67bc41f 13ad85c 67bc41f 13ad85c 89ecc9b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 |
---
language:
- en
thumbnail: "url to a thumbnail used in social sharing"
tags:
- classification
license: "mit"
datasets:
- SetFit/qqp
models:
- microsoft/deberta-v3-base
metrics:
- accuracy
- loss
widget:
- text: How is the life of a math student? Could you describe your own experiences?
- text: Which level of preparation is enough for the exam jlpt5?
example_title: "Classification"
---
A fine-tuned model based on the **DeBERTaV3** model of Microsoft and fine-tuned on **Glue QQP**, which detects the linguistical similarities between two questions and whether they are similar questions or duplicates.
## Model Hyperparameters
```python
epoch=4
per_device_train_batch_size=32
per_device_eval_batch_size=16
lr=2e-5
weight_decay=1e-2
gradient_checkpointing=True
gradient_accumulation_steps=8
```
## Model Performance
```JSON
{"Training Loss": 0.132400,
"Validation Loss": 0.217410,
"Validation Accuracy": 0.917969
}
```
## Model Dependencies
```JSON
{"Main Model": "microsoft/deberta-v3-base",
"Dataset": "SetFit/qqp"
}
```
|